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monitors did not appear to provide experiences that increase 
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ABSTRACT 



The Second Language Monitor Program exists to promote the learning and use 
of Canada's "Official languages. But„ does it achieve this objectfive? A , 
study was undertaken during the 1979-80 school year to answer this question, 
at least for a small part of the Program. The study was restricted to 
French Monitors who work part time; these indivisJuals are in schools the 
equivalent of one day per week. Another reltricti^on on the study was that 
the Monitors be employed in tore-French cLisses; these classes study French ' 
for a short time each day, usually 20 minutes. 

A substantial, carefully balanced sample of, students CN=324D was 
obtained in three provinces-Saskatchewan, Prince Edward Island, and Nova 
Scotia. Twenty-eight schools and 56 classes were studied in these three 
provinces , and a further five schools and 10 classes in Manitoba and 
Ontario. Half of the sample was served by Monitors and the other half not 
(Monitor schools' we^e- assigned first by local decision, and Control schools 
were then matched to them) . Classes were selected 'from grades 5-9, all 
but four of them enrolling students in their first or second^ year of French 
study . 

Each student' was interviewed individually for about 30 minutes, and a 
standardized test of French Listening Comprehension was given in each class 
in May 1980, after almost all Monitors had completed their work for the year. 
Interviewers were fiuently bilingual and had attended a three-day training, 
and practice session in Toronto to prepare to use the structured interview. 
• Roughly half of the interview was in English and half in French, with a few 
instructions for the French tasks given in English. Interviewers made both 
detailed ratings of small tasks during the interview and global ratings of 
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French competence at the end. Attitude, knowledge, and experience scores 
^were derived from the English intei'view. Each Interviewer worked in only 
/ one province. 

Data from Saskatchewan, Prince Edward Island, and Nova Scotia were 
analysed in a multivariate analysis of variance that reflected the hierar- 
chical design (students in classes in schools in provinces) and the multipi 
outccmie measures. 

Monitor and^ Control groups pro\'ed to be well matched on general charac 
teristics. The Monitor groups, howei^er, reported that they had more and 
better experiences in French. The Control groups were^xated marginally 
higher on global competence, while the sums of the detailed ratings were 
marginally, but not statistically significantly, higher for Monitor groups^ 
It seemed that interviewers in two provinces applied rnpre traditional 
criteria than those in the third, favoring the Controls! 

Monitors do not appear to provide experiences that increase competence 
in any conventional way,, and if the ratings of two judges are accepted. 
Monitor students may exhibit slightly lower conventional competence. 
Monitors do add desirable anfl Unique cultural elements, justifying their 
designation as cultural ambassadors. 



\ 
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1, • BACKGROUND ANE PURPOSE OF THE EVALUAT-ION 




The Second Language Monitor Program was introduced in 19^3 to promote the 
learning and use of Canada »s two official language?. University students \ 
working under the* direction and supervision of professional second- language 
teachers take pa,rt in non-teaching activities at the elementary, secondary, 
and post- secondary levels. These '^Monitors" work in schools for six to 
eight hours a week, and in return they receive a grant (approximately $3000 
in 1977-78) plus the cost of return transportation from their home province 
to the host province. Monitors must ordinarily leave their province and 
must always enroll in a post- secondary institution. 

The program is funded by the Department of the* Secretary of State 
(Ottawa) and is administered jointly by a committee Qf proviiicial 
coordinators and a national, coordinator in the Secretariat of the Council 
of Ministers of Education, Canada, 

In April 1979, the Secretariat issued a^request for proposals to 
evaluate the French -language segment of the Program, Proposals were screened 
by the Joint Evaluation Committee of the Council, and tl ^ Ontario Institute 
for Studies in Education (OISE) was selected to carry out the evaluation. 
This is OISE*s report. 

It was intended that the evaluation touch all aspects, of the Program, 
Effects on students in schools served by Monitors was to receive priority, 
and benefits, if any, to Monitors were not part of the study. The high 
demand for Monitors suggested that school officials felt the Program was 
worthwhile- and that-it~-did..noJt impose unreasonable demands. In i^esponding 
to annual requests for feedback, teachers and officials involved in the 



Program consistent Jv reported to. the Council of Ministers that Monitors 
played a significant fole -in promojirig. the learning and use of Canada *s 
official languages. ^ What was needed, therefore, was systematic and objfsc-' 
tive evidence of impact on stud^ts. 

. foi:, reasons af economy and efficiency, the Joint Evaluation Committee 
decided that attention in this evaluafion Vould be focussed dh students whc 
had worked with Monitors in core.-Frc^clj. classes during *the students' first 
or second year of .French study^' fiiis' decision shaped the evaluation td a 
very great extent; as detailed below. v 

Within the groups df students selected for study, attention was \ ^ 
concentrated on competence in understanjiing and speaking French, on know- 
ledge of French culture, and .on attitudes toward French and French culture. 
In addition, observations wer,e made in French classes in the attempt to 
document, -df possible, the presence of Monitor-induced effects upon the ' 
learning environment of the French classroom. The same measurements and 
observations were made in a sample of classes in schools where no French 
Monitors had been assigned (but which were very much alike otherwise) in 

I 

order to assess whether or not th^re were any differences that might be 
attributed to the work of the Monitors. 

Tn summary, this is an evaluation of the p*ar.t of th^ Second Language 
Monitor Program that involves grades ,5-9 core French classes where students 
are in their^ first few years of language study. A survey at the ^e^inning 
of the evaluation (details of which are reported. below), suggested that 
classes such as these make up about 14% of the program* The primary -goal 
was to discover whether or not there were measura))le effects on students 
of the activities conducted by the Monitors.' 

The Monitor Program in Early Core' French 

The generally valid descriptions of the Program have already been" given- 
each Monitor spends six to eight hours pOT week, woa^king in one or more 
schools, supervised ^and directed by a qualified teacher of Fi^ench as a 

second language. Regulations specify that Monitors are* not to be used in 

ft 

place of regular teaqhers. French Monitors are university students whose 

Classes a:re designated "core** if they meet no more than 20 to 40 
minutes per day, five^days a week. Classes meeting 40 or more minutes 
per day, up to half-time are often called "extended,**' while 50 or more 
minutes is regarded as n jform^of"- ** immersion." 

1.1 ■ • 



first language is French (the great majo'rity come from • Quebec) , but "beyond, 
that they differ widely, being enrolled, in the full range, of university 
undergraduate programs. A few a^e assigned to one school for the entire 
year, but most visit 'niore than one--either ^hanging after a period,of time ^ 
or rotating on a regular basis. 

While total time s^nt learning is clearly important, recent research 
on second-language learning has shown that the nattire and distribution bf 
time are all important (see, e.g. Stem, 1978, and Lapkin,. Swain,. Kamin,. - 
and Hanna, 1980). Wien one assesses the amount and kinds of impact 'Monitors 
might have, it is important to know whether they increase the time students 
spend learning French or alter its, character, or both. 

'Reports from provincial coordinators, teachers. Monitors, and s'^udents- 
indicate 'that, in the vast majority \f schools where Monitors work with 
core- French classes, students spend time on French in different ways but^ ^ 
total time spent learning is not increased. Monitors most often work with 
small groups' who are withdrawn from the regular French class. Some attempts' 
■wel-e reported to launch French clubs, or' to have after-school activities, but 
both the Monitor and the school schedules seemed to rule out provision of 
extra time in thiS way. • ' , . • 

The above description cannot be documented in a thorough way, since the 
evaluation was concentrated on student outcomes. .Reports are so consistent, 
however, and the constraints under which Monitors operate in core-French 
programs are so similar, that we feel the description is accurate. 

' Very little can be said about the kinds of activities students experi- 
ence with Monitors. In order to minimize possible rater bias, inter-viewers 
were- not told which schools had Monitors and which did not, nor, of course, 
.did they ask about Monitor activities.. Monitors had completed their year's 
work before interviewers visited the schools, and only one Monitor agreed 
to oiar request to keep a log of activities. Any future study should giye 
attention to Monitor activities . ■ ' *" 

' ., Clearly, students ought to have more opportunity to speak French in 
a small group" than a large one, but we don't know for sure that they did. 
We can only assume thaf the. time ,spent with the Monitor was more intense 
• for each student than it could be in the regular class. In cases where 
the Monitors worked- with 'students withdrawn fyom a class, this intensity 
would also hold for those who, stayed in class; in other words, there might 
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be a ^^monitor effect** indirectly caused by giving the remaining students a 
more intense time with the teacher, ^ 

Papers^ Morrison, Walsh; Pawley, and Bonyun (1979) and Genesee (1979) 
have suggested that the intense time generated by early or late immersion 
could yield results superior to those achieved by core-French students who 
actually accumulated more time in class. No one really knows how long it 
takes to make what progress at what age and undei^what conditions, however, 
so it is difficult to say what one should reasonably expect the Monitors to 
"achieve in terms of improved student competence* Two vei^ recent studies 
(Hanna, Smith, McLean, and Stem, 1980; McLean, 1980), though supplying 
only weak evidence, suggest that our expectations should be Very modest, 

Hanna et_ al. (1980) found that about 50% of secondary schodl students 
showed modest gains on listening comprehension tests and oral proficiency 
interviews after an intensive four-week bilingual exchange experience, 
where a French English group spent two weeks in a French milieu and two 
weeks in an English one. Since that summer program added to the classroom 
experience, total time spent on language and the intensity of the experience 
exceeded that provided by Monitors. 

From results of testing new French items in ^^core-French classes having 
di;fferent amounts of instruction, McLean (1980) estimated the gains that 
mig>t be attributed to an e?.tra 180' or 360 hours of .core Fre^ich. Estimates 
ranged from 0 to 10% more items correct at the grade 6 level to 10% to 20% 
more correct ^t grade 10.^ In this evaluation of the Monitor program, a 10% 



gam (three or four items on the lEA Listening Comprehension Test, for 
example) would be just detectable, but no students in core-French programs 
are able to work with Monitors the equivalent of an extra 180 hours during 
a single school year. 

* ^ I'hus, the main implication of recent research on second-language lear.?- 
irig in a variety of core-French settings is that measurable effects of 
Instruction can be expected to be small, relative to other sources of 
variation, and that such effects will be difficult to establish by 

statistical methods. When* tlve teaching/learning exp^'rl:eni:e l3 as^ small 

in time and variable in nature and intensity as Monitor schedules suggest 



ERIC 



2 

lEA stands for International Association for the Evaluation of 
Educational Achievement. > 



7 



-5- 



it has to be, research on outcomes of education in general would predict 
that no differences attributable to Monitor activity would be found in 
such measures as test scores. ^ 

A modest, worthwhile language improvement goal was suggested by a 
provincial coordinator. "The effect of monitors,*' the coordinator said, 
"is to loosen the tongue and sensitize the ear." Operationally, one con- 
cludes that students should bo more willing to speak French, should speak 
it more freely, and should exhibit better comprehension of spoken French. 

Rationale for the Present Study 

The design of this study was chosen to maximize chances of detecting 
Monitor effects, within the prevailing practical and financial constraints. 
On the one hand, the choice of beginning core-French classes was appro- 
priate because of the number of Monitors so engaged, but, on the other hand, 
it is also where the effects are likely to be most dispersed. The study, 
therefore, was designed to case a wide "net" for effects, a net of the 
smallest mesh obtainable under the circumstances • 

Students were interviewed individually in 33 schools (17 with Monitors 
and 16 without), in both English and French, in order to judge their 
competence in speaking and listening and to tap their knowledge of and 
feelings toward French language and culture. A standardized French 
listening test was given. In addition to the nearly 400 interviews with 
students, the interviewers observed classes and talked with teachers, 
submitting both quantitative reports (summary codings) and written des- 
criptions. By these meanJ^, no important, general effect of the Program 
should have slipped through the net. . 
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"2. REQUIREMENTS OF THEtLIENT AND METHODOLOGICAL CONSIDERATIONS 



The Joint Evaluation Committee imposed six constraints on the study. Three 
of these pertained to the grade levels of the students who were to 'be in- 
volved in the evaluation, the general nature of the program of French in- o 
struction they were experiencing and the length of time they have been 
studying French. 
Specifically: 

1. The focus of the evaluation was to be on students in grades 4 to 6. 

2. The students were to be studying French in a "core" program, i.e. 

a program in which French instruction is provided every school day 
(usually) for a relatively brief period of time (e.g. 20 minutes) . 

3. The students were to be in their first or second year of the study 
of French. 

The Sample and the Program ^ 

To discover whether or not it would be possible to work within these require' 
ments, a cross-Canada survey was conducted during September and the, first 
part of October 1979. The purpose of this survey '.-.-as to determin^/he grade- 
level and program assignment of each part-time French- language Monitor. The 
survey results reported in Table 1 reveal that about two-thirds of the part- 
-t44ne.- Monitors Jiad,b£fia-aasign-ei to_ core- Fr^^ 



fewer than one- fourth served programs for students in their first or second 
year of French- language instruction. Fewer still of the Monitors had been 
assigned to programs for students who were in grades 4 to 6 and also in 
their first or second year of French instruction.' 



T^ble 1 



Actual or Estimated Number of Monitors Assigned 
to French PrograiTtS, by Province 



Core 



Province 


First or 
Second Year 


Other 


Inunersion 


, Total 


Newfoundland 


4* 


8* 


2* 


14 


Prince Edward Island 


10* 


4* 


10 


24 


Nova Scotia 


8* 


22* 


4 


34 


New Brunswick " 


2* 


1* 


2* 


S 


Quebec 


0 


40 




40 


Ontario 


16* 


128* 


125 


269 


Manitoba 


7 


10 


12 


29- 


Saskatchewan 


15* 


15* 


5* 


35 


"Alberta 


9* 


46* 


17* - 


72 


British Columbia 


13* 


51* 


23 


87 



Total 84 325 200 609 

% 14 53 33 100 



^Tirst or Second Year*' indicates first two years of French study. 

Estimated from comments of provincial and local coordinators, or 
from grade core begins, assuming equal distribution of Monitor 
— oveir*grades% ^-^^ — — — — ™ — ^ . . 
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Oii the basis of the survey results, OISE (the^contractor) presented 
the Joint Committee (the client) with a recommendation for modifying the 
first design requirement. This recommendation, which was accepted, was 
that the range of grades should be expanded to include grades 7-9 • With 
this modification, 'the survey results suggested that it would be possible 
to satisfy requirements 1 to 3, 

Of the remaining three constraints, two reflected a desire for results 
havdng a satisfactory degree of internal and external validity (Campbell 
and Stanley, 1963). 

4, A matching design was to be employed in which students in contact 
with Monitors would be compared with students not in contact with 
Monitors . 

5, The generalizability of any significant result was to be assessed, 
A Comparative Study 

In an attempt to ineet these requirements, the contractor proposed, and the 
client accepted, a design that can be described as follows: 

(a) A multistage sampling design would be employed in which the primary 
sampling unit would be the school board. The target number of boards was 
set at 10. They were to be widely distributed geographically; data would 
be collected in at least three different provinces. (The survey results 
suggested that it would be possible to meet this objective, and satisfy 
the client's desire for an assessment of the generalizability of Monitor 

effects.) ' 

(b) The secondary sampling unit within each board would be the school. 
An attempt would be made to involve four schools from each board, for a 
total of 40 schools. Of the four schools per board, it was planned that 
two should be experimental in the sense that they employed part-time 
Monitors in the core- French programs of interest to the client. The other 
two schools were to be control schools; these would not enjoy the services 
of a Monitor. 

(c) The schools within each board would be matched as well as possible in 
pairs. Each pair would include an experimental and a control school. The 
matching variables would be the socio-economic status of families in the 
neighborhoods served by the schools, the grade levels of the students in 
their first or second year of instruction in a core-French program, the 

\ 
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length of time devoted each week to core-French instruction, the training 
and experience o£ the French teachers, and the willingness of the teachers 
and the school administrations to accept the services of a Monitor, 
(d) The tertiary sampling unit within schools would be the student. Because 
some of the data that were to be collected could not be obtained from all 
eligible students within each schooltime and resources did not permit this, 
c kind of matching of students would be attempted across pairs of schools, 
and these data would be obtained only from matched students* It was pro- 
posed that the eligible students in a school, whether the experimental or 
the control school of a pair, be stratified on the basis of sex; within 
each sex group, the students would be stratified by year of French instruc- 
..tion, first or second— this meant choosing students from different classes; 
within each se;^-by-year-of-French- instruction group, the student^ would be 
ranked for achievement in French. Then one student from each third- -top, 
middle, bottom— of rank order would be selected ^or study. This procedure 
would result in the selection of 12 students from each school. 

In the foregoing description can be found the contractor's desig^^ 
objectives. Practical exigencies prevented the contractor from meeting all 
these objectives. Details of where they were not met, and why, are 
presented in two later secrions bf tKis report"^ The Actuai"^San^^ 
Selection, and Measuring the Match Between Schools. 

The sixth and final requirement of jthe client^ dealt jLn 3 generaLway 
with the variables or measures on which the evaluation was to be based: 
6. The measures were to be language proficiency or competence, attitude 

toward the learning of French, knowledge of French culture, and in- 

classroom behavior during French class. 

The Measures 

To operationalise this requirement, the contractor proceeded as follows: 

French proficiency and competence were measures using two very 
different procedures- -a standardized test of listening comprehension and 
a structured interview. ^ 

lEA Listening Comprehension Test 

This test was designed for Population i of the lEA study of the teaching of 
French as a foreign language (Garroll, 1975). This instrument was chosen 
for use because it appeared to be an appropriate level of difficulty for 
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students in their first or second year of French. (Population 1 in the lEA 
studies included ail loVear-old students who were studying French [Carroll, 

1975] .) ^ 

The test and how it was administered and scored in this study can be 
described briefly as follows. The test requires approximately 20 minutes 
to administer and contains 35 multiple-choice items, feach item consists of* 
a spoken question and four picture responses. The student chooses one 
picture in response to each question. All eligible students present on the 
day this test was administered were tested. A member of the school's staff, 
usually the French teacher, took responsibility for the administration. To 
standardize the procedure across schools, the questions were presented from 
a taped recording. Students' responses were scored by project staff. The 
score a student was assigned equalled the number of correct answers. 

t 

Individual Interview- -French 

The structured interview was prepared specifically for use in this study. 
The thirty items to this interview are given in Appendix A. The first 24 
were in French, and students were expected to respond in French. For all 
but item 18, the student was requested to produce a response; item 18 asked 
the student only to read each of ei^^ numbers in French. In items 25 to 
27 the student was presented with a situation, described in English. The 
student. was then asked to respond appropriately in French. The last three 
-ta^ks of the interview, numbers 28 to 30, asked the student to repeat in- 
French each of three French sentences read aloud by the interviewer. Each 
sentence was read twice before the student was asked to respond. 

The standardized French interviews were conducted by trained project 
staff. During each different interview the same 30 items and opportunities 
for responding were presented and a standard record was prepared. For 26 
of the first 27 items— item 18 excluded--the interviewer recorded two 
judgements: 

1. The correctness of the response (in three categories— no response, 

g■^P?^?^^ ^■"■^•y^'^^ jresponse) , and . 

2. The completeness of the correct response (in five categories— no 
response, single word, phrase, simple sentences or long sentence). 
(See Appendix A, The Interviews.) 
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In addition to these judgements, the interviewer Ji?ade a note each time a 
student was prompted for a response. (For details, see Appendix A, ' 
Instructions to Interviewers.) 

A different procedure was followed in recording a student ^s performance 
on item 18 and the final three tasks in the French interview. For item 18, 
a count was made of the number of numbers that the studefit read correctly. 
In addition, the interviewer judged the overalj^ quality of response on a 
four-point scale. ^ 

The final three items in the questionnaire, it will be recalled, were 
^^elicited inSitation'* tasks (see, e.g. Naiman/- Frohlich, Stem, and Todesco, 
1978). Each sentence the student was t8 repeat was divided into several 
parts — there were three parts to items 28 and 29 and four parts to item 30. 
The first recording made by the interviewer was of the number of parts of 
the sentence that the student attempted to repeat. The second recording was 
of the number of parts repeated correctly. 

At the end of each French ^interview, the interviewer made five summary 
ratings of the student ^s performance (referred to below as ^'competency 
ratings'*) . The characteristics rated were pronunciation, fluency, grammar, 
vocabulary, and comprehension. Each was rated on a five-point scale, 
-aeflned^ as f oirowT: ^ — ^"^ 

Pronunciation 0 = often unintelligible 

^.'^_9^yi?^sAy foreign but rarely unintelligible 

2 = foreign but always intelligible 

3 = sometimes foreign, always intelligible 

4 = native- like ^ 

Fluency 0 = every utterance requires enormous obvious effort 

1 = ^very hesitant, often long pauses before answering 

2 = hesitant, must pause before answering 

3 = rarely hesitates 

4 = responds as well as in English 

_ .0 ^.na Gon.tml-^^of^^synt-ax^-often-conveyS'-v^^^ 

1 = fair control of syntax, can convey meaning of simple 

phrases, although there are frequent errors 

2 = good control of syntax, conveys meaning well, can 

formulate simple sentences, there are still errors 



t 



20 



3 = very good control, formulates more complex sentences, 

relatively few errors 
4-= very good control, complex sentences, almost no errors 

Vocabulary 0 = almost no vocabulary at all 

1 = adequate for basic courtesy requirements 
•2 = simple social^ and school needs 

3 = adequate for simple general conversations 

4 = very good vocabulary, can handle routine social 

general conversations 

Comprehension 0 = did not understand most of the questions asked, 
required frequent repetition, slow sjpeech 

1 = understood most of what was said, required slow 

speech, some repetition * 

2 = understood almost all of whatwas said, could follow 

slow speech with almost no repetition 

3 = understood almost all of what was sa-cd at normal 

rate of speech, very few repetitions 

4 = could follow all of what was said, no repetition 

required 

In summary, 17 scores were derived from the information collected 

during- a-French-interviewT" - Four-^of -these^4vere„Msed„.on^the.,mc.^^^^ a„ 

student «s responses to 23 of the first 24 interview items (item 18 excepted), 
those asking a response- to a simple question. These scores were: 

(1) the number of failures to respond (scale: D-23) 

(2) the number of correct responses (scale: 0-23) 

(3) a quality score--the sum of the completeness-of- 
correct-response scor.ps (^ale: 0-92) 

(4) the number of items for which the interviewer 
prompted the student in an effort to elicit a 
response (scale: 0-23) 

A second gro^ip of four were: 

(5) - (8) the same scores, but based on responses to the 

^XsTLtuations (items 25, 26, 27). 
^,F^ch^tudentAs_respo^se the remaini ng items -18, 28, 29, and 30-were ^ 

used to derive four scorV^ 

(9)- (10) number cot^ct, and overall quality for 

responses to\item 18 

(11) -(12) the number of uhits attempted and the number , 
correct for the elicited imitation tasks 
(items 28-30). 



Finally, there were the global ratings: 

(13)-(17) pronunciation, fluency, grammar, vocabulary, 
and comprehension. 

Lower-bound estimates o^ reliability of the scales composed of more 

than one item are reported in Appendix B. These figures suggest that the 

scores derived from the French interview were highly reliable, at least 

as compared with the reliability estimates usually obtained for scores on 

standardized tests of achievemerit. Reliability estimates could not be 

obtained for the five siMmary ratings from the data that were collected 

Individual Interview--English 

Attitudes toward the learning of French, knowledge of French culture, and 
the quantity and quality of a student's experiences in French class were 
assessed from responses to 35 items presented in a 10-minute (approximately) 
structured interview conducted in English by the same interviewer. The 
same students who were interviewed to assess their competence in French also 
responded to the items of the English interview. (See Appendix A for a' 
copy of the interview.) The English interview actually preceded the French 
interview. Because it was conducted in English it provided the interviewer 
with an opportunity to make the student feel comfortable before the assess- 
ment of competence in French was made. 

For 23 of the items, the expected response was yes or no. Another 
nine items asked the s^tudent either to name as many examples^s- possible^xjf^ 
a particular kind of activity or event or to indicate how frequently the 
French class engaged in a particular activity. * The interviewer recorded 
the examples named to items of the former type and coded the frequency of 
an activity to items of the "latter type. The scale for coding frequency 
haii six points--never, once a month, twice a month, three times a month, 
once a week, and more than once a week. The remaining three items required 
the student to describe one thing that was liked about the French class, 
one thing that was disliked, and to give a reason for preferring one French 
£lass to another French class, if in fact the student had such a preference. 
(It was intended by this to find out whether or not students would state a 
preference for Monitor-assisted classes, if the student had experienced 
such classes..) 

A student's r^onses to items 1 to 4 and 33 to 35 of the English 
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interview (see Appendix A) were used to obtain an attitude score. Yes 
responses to items 1, 4, and 33 to 35 each contributed one point to the 
score. Naming one thing that was liked about the French 'class also 
cdntributed one point. Thiis the range of scores on this stfale was -1 to 6. 

A knowledge-of-Fren.:h-culture score was derived from the responses to 
items 8, 9, and 16 by adding the codes assigned by the interviewer to the 
first two of these items, and adding >5ne additional point if the student 
had been able to name a French holiday. The range of scores on this scale 
was from 0 to 7. ^ ^ 

A student's responses to the remaining items in this interview were 
used as the basis for two scores, one reflecting the quality of the student' 
experiences in French class, the other reflecting the quantity of his or her 
experiences. The first score ranged from 0 to 17, and was obtained by 
counting the number of Yes responses coded by the interviewer fox- items 
6, 10, 11, 13 to 15, 17, 19, 20, 22, 24, 25, 27 to 29, 31, and 32. The 
second score ranged from 0 to 35 and was obtained by su.--ning the responses 
coded for items 7, 12, 18, 21, 23, 26, and 30. , 

The four s.'^ales derived from „the items of the English interview do 
not achieve as well as might be desired the two associated objectives of 
the evaluation— to measurer knowTedge of Trench- cirlture- and-attitudes toward- 
French and French culture. The scale of knowledge of French culture was 
-based__on .only^ three Items, and thus sampled a very limited portion of the 
associated domain of knowledge. Results based on this scale are valid, » 
nonetheless, although only limited generalizations can be based on them. 
In addition, it should be recognized that the scales assessing quality and 
quantity of experiences in French class also bear indirectly on knowledge 
of French culture. These scales assess dimensions of the opportunities 
students had in French class to learn about French culture. 

The assessment of attitude toward French and French culture was least 
adequate of all. This was by design. Attitude must be measured by seeking 
information about a student's typical response. This type of response is 
easily faked by the student who can guess the intention of the interviewer. 
Also, typical attitude questionnaires, especially those that attempt to 
^conceal the .purpose of the questionnaire from the student, yield measure- 
ments of dubious quality, in part at least because the questioii? often deal 



with situations, events, etc., outside the experience of the student. In 
the end, it was decided to concentrate on the student *s attitude owrjird 
the learning of French. Questions about this can at least be rela& by 
the student to his or her experience in French class. Moreover, positive 
responses reflect an openness on the part of tixe student to continued 
learning of French and to continued acquisition of knowledge about French 
culture. 

' ' In summary, the English interview yielded the following scores: ' 
(1) Attitude to Learning French (scale: -1 to 6) 
(2^ Knowledge of French Culture (scale: 0 to 7) 

(3) Quality of Experiences in French Class (scale: 0 to 17) 

(4) Quantity of Experiences in French Class (scale: 0 to 35) 
Lower-bound estimates of reliability are reported in Appendix B for 

the scores derived from the English interview. These estimates are 
certainly smaller than the estimates usually obtained for attitude 
questionnaires. It should be noted, however, that these are lower-bound 
estimates of reliability, i.e., we can expect that the reliability of the 
scores is not less than these estimates. Also, three of the four scales 
are composed of few items, and one of these is composed of very few items 
indeed. It is weH known th^^^ is an increasing function of 

scale length. Enhanced reliability could be achieved by increasing the 
length of these scales. Finally, since results were aggregated to the 
classroom level, the reliability of individual scores w^ not as important 
as in studies of individual students. In other words, the group compar- 
isons in this study should not be downrated on. reliability grounds, 

Classroom^Observation 

To obtain information on possible monitor-induced effects in the French 
class, it was decided, after observing several core-French classes, to 
concentrate on the interchange between teacher and students. The reason 
for this decision was that the principal method of instruction appeared 
to be question and answer, with the teacher asking a question either of 
the class as a whole or, more frequently, of an indi^idualv ' These were 
observed to be rapid-fire sessions, with the next question following 
quickly upon receipt^' of a correct ans>ver. At issue was whether or not 
observable characteristics of these exchanges were affected by the Monitors 
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Becnuse of the' pace at which quest ion-and-answer sessions are 
conducted, an observer can attend to only a few of the many characteristics 
of the exchah^es between teacher and students.' Consequently, a relatively 
simple classifipation scheme was devised for student responses- They were 
classified as^ro^p or individual r-^sponses. Each response from an 
individual if given^iii^French was classified as correct or incorrect and 
rated for completeness (quality) on the same scale used in the French^ 
interview. If no respfanse was made, the fact was noted, as. was the^ 
occirrence of a response, in P.nglish- In the event that a student's ^ 
response was either in incorrect French or given in English, or if no 
response was forthcoming, note was taken of the teacher's next behavior— 
whether it was 'to prompt the student, to move to another student, or to 
provide an explanation in English. A prompt was further classified accord- 
ing to whether it was in English or French, and, if the latter, whether it 
was to elicit a response or to correct an incorrect response from the^ 
student. 



3.- :the actual sample and its selection 




As of mid-October 1979, the pattern of Monitor assignments by grade leve.l 
and program type was that described in Table 2. Approximately one-third 
of the. Monitors had been assigned to immersion classes, and almost that 
number htfd been^ 'assigned pt the high school level. The only provinces 
where a relatively large number of Monitors had been assigned to 
elementary and intermediate core-Frjsnch classes were Prince Edwa^rd Island, 
Alberta, l^ova Scotia, Saskatchewan, and British Qolumbia. It was not ^ 
possible to estimate accurately how-many of these Monitors had been 
assigned to work with student's in their first or second year o£ €he study 
of French. It was concluded, however, that approximately 85 Monitors (14%) 

-^had^been-.so assigned*, -5- , — • - - . 

This information was used tfo select the school boards that were 
invited to participate in the study» Several criteria were employed in 
making this selection. The boards that were chosen 
fal were clustered in several majbr centres ' / 

(b) apparently haS assigned 't^wd or more Monitors 
to target core- French programs 

(c) offered a choice of schools to match with*' Monitor- 
served schools, and * 

(d) were relatively near to boards employing full-time 
Monitors. (With this criterion satisfied, M was 
possible to reduce tKe costs involved in conducting 
,the companion study of 'full-time Monitors.) 

The initial selection of . boards having been made, the provincial and local 

coordinators were contacted to^arrange site visits to each bo^rd. 
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Distribution of Monitors by Grade Level 
Both Immersion and Core 




* 

• 








Grade Level 










K-6 




7-9 




• 10- 


13 . ■ 




^ I Province 














Total 
















* 


.Newfoundland 


'2 


4 


— ■ 


4 




4 


14 


/ Prince EdwarJ^. Island 
Nova Scotia 


6 

. 4* 


14 

.12 


— 


-- 

14 




4 


2.4. ' : 

34 


New Brunswiek 


2 ■ 


_ 


— 


. 3 




— 


5 '™ 


Quebec 






— 


— , 




40 


40 , 


Ontario 


• 














Ottawa' • 


46 


36 


IS 


— 


1 


20 


lis 


^ ."g^ Toronto 


41 


4 




5 




37 ■ 


87 


• Other 


22 


•5 


— 


3 




34 


64 


■ ' ♦ • ■ .* 

Manitoba 


•8 


7 


3 


7 


. 1 


3 


29' 


Saskatchewan 


•s 




— 


20 




10 


35 


Alberta ^ 






* 










Calgary/Edmonton 


17 


15 


— 


.7 ' • 


— 


. 5 


44 


Other* 


— 


— 


— 


16 


— 


12 


28 . 


British Col^bia 






> 










Coquitlam 


9 






5 




3 


17 


Other* 


14 


38 




11 





7 


70 ■ ' ^ 


Total 


176 


135 


22 


95 


2 


179 


609 




28.9 


22.2 


03.6 ^ 


IS. 6 


0.3 


29.4 


100 * 




51.1 




19.2 




'29.7 






% , ^ Estimated 
> 
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It was apparent after the first few site visits that the target popula- 
tion was smaller than had been estimated on the basis of the survey. There 
were two major reasons for this. The first was that all boards had a priority 
system for assigning Monitors to schools; in most cases the beginning grades 
of the core program had the lowest priority. If a board did not receive its 
expected quota of Monitors, the requests for Monitors to serve classes in the 
first two years of the core program were the first to be eliminated. The 
second reason was that overall policy on the starting grade for core French - 
was not always applied by individual schools. For example, it was discovered 
during the course of a site visit that, while board policy specified that the 
core program start in grade 5, the Monitors had all been assigned to schools 
where the core program actually began in grade 3. Thus, it was discovered 
after the^ study had begun that there were no schools in this board that met 
the criteria for inclusion in the study. 

Even by going into as many as five provinces, it was not possible to 
achieve the target of 40 schools, 20 with Monitors and 20 without Monitors," 
since the target population was relatively small and was dispersed over a 
very large geographic area. When a problem of any sort prevented one of 
the sample schools from participating in the study, it was usually not 
possible to find a replacement school in the-same geographic area. To 
compound the problem, four schools that had initially agreed to participate 

' (decided in May of 1980— far too late to find replacements— that they could 
not. In one of these schools,. the reason given was that the Monitor had 
been dismissed early in the year, hence the school could not be regarded 

'as an experimental one. The reason given by the other schools for dropping 
out of the study was the "difficulty" of the test instruments; it was felt 
that they would provide a negative experience for the students. 

In the end, the sample comprised 33 schools, 17 wi^th Monitors and 16 
without. Nine school boards were represented, and five provinces . The 
sample in three of the five provinces was of a substantial size (i.e. at 
least eight schools) . 
s^' Sample Recruitment and School Characteristics 

■ After a board"^had been chosen fof inclusion in the study, initial contact 
was made with the provincial coordinator, informing him of this decision. 

■ . This contact was followed by a letter to the five provincial coordinators 
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requesting their assistance in enlisting the cooperation of the designated 
boards in their provinces, A letter outlining the scope and purpose of the 
study was then sent to the local .coordinators. All the provincial and local 
coordinators who were contacted agreed to help enlist schools • Site visits 
by a project officer were then arranged, usually through the office of the 
provincial coordinator. 

During a site visit, the project officer usually met first with the 
provincial coordinator to obtain detailed information about operation of the 
Monitor Program in the province and then with the local coordinator to 
identify Monitor schools and to choose a Control ^school for each Monitor 
school. 

The Control schools were matched as closely as possible to the Monitor 
schaols. The basis for matching was the socio-economic s^-atus of the 
neighborhood served by the schools (as judged by the coordinators), the size 
of the core-French classes, the characteristics of French programs, and the 
training and experience of the French teachers. Table 3 contains informa- 
tion about each pair of schools in the sample on these characteristics. 
Inspection of this table reveals that matching was reasonably good on all 
variables except whether or not the teacher of core French was a Francophone. 
Very few teachers, only eight of 33, were Francophones. 

Once the choice of schools in a board had been agreed upon, the project 
staff member and the local coordinator visited each school and met with the 
principal and French teacher(s). The purpose and scope of the study were 
explained. Then the target classes were identified, a description was given 
of how students within classes were to be chosen for the interviews, and a 
description was provided of the lEA Listening Test, the structured interview, 
the student questionnaire, and the classroom observation procedure. All but 
one school agreed* at this point to participate in the study. A tentative 
timetable for the administration of the lEA Listening Test and the student 
questionnaire was then established with each school. It was stressed during 
this meeting that the results of individual students and the identity of 
teachers, schools, and boards would be kept strictly confidential. 



Table 3 

Characteristics of the Schools Participating in the Evaluation 



Class Characteristics 



Program Characteristics 



Teacher Characteristics 



:ov. 


Board 


School 


Exp 

or 

Con. 


SES 


Grade 


Glass 
Size 


Grade 


Class 
Size 


Days > 
in 

Cycle 


French 
Periods 
per Cycle 


Min- of 
Brench 
per Cycle 


Exper. 


Special • 


rranco • 




1 


1 


E 


1 


7 


10 


8 


9 


6 


3 


135 


X 


X 




I 


1 


2 


C 


1 


7 


16 


8 


14 


6 


3 


135 ' 


X 




X 






"i 

o 


p 


1 


7 


18 


R 


13 


6 




180 




X 




I 


1 


4 


C 


1 


7 


23 


8 


19 


- 6 


5 


200 


X 




-9 






• 

5 


F 


2 


7 


14 

Jk*t 


R 


30 


6 


" . 3 


120 


X 


X 




I 


2 


6 


C 


2 


7 


17 


8 


16 


6 


4 


120 


X 


X 








7 


F 




7 


14 


R 


14 

Jk *t 


6 


3 


100 


X 


X 




I 


2 


8 


C 




7 


20 


8 


• 29 ' 


6 


3 


105 


X 


X 




c. 


T 
O 


G Q 


F 


2 


c 


28 




28 




s 


150 


X 


X 


1 


2 


3 


10 


C 


2 


5 


18 


5 


26 


6 


3 


120 


X 


X 


2 


3 


11 


E 


2 


5 


30 


5 


28 


6 


3 


105 


X 


X 


X 


3 


4 


12 


E 


4 


5 


30' 


5 


26 


5 


4 


100 


X 


X 




3 


4 


13 


C 


4 


5 


30 


5 


30 


6 


4 


120 


X 


X 




3 


4 


14 


E 


5 


5 


26 


5 


16 


6 


4 


100 


X 


X 




3 


4 


15 


C 


5 


5 


24 






6 


4 


120 


X 


X 


X 


3 


5 


16 


E 


1 


•5 


30 


6 


17 


6 


4 


100 




X 




3 


5 




C 


1 


5 


9 ' 


6 


15 


6 


6 


120 








3 


5 


18 i 


E 


1 


7 


22 


8 


30 


6 


6 


120 


X 






3 


5 


" i 


C 


1 


7 


13 


8 


12 


6 


4 


135 


X 


X 




3 


6 


20 


E 


1 


5 


20 


5 


23 


6 


3 


90 


X 




X 


3 


6 


21 


C 


2 


5 


26 


5 


26 


6 


4 


100 


X 


X 




3 


6 


22 


1 E 


1 


5 


28 


6 


29 


6 


6' 


150 


X 


X 




3 


6 


23 


i c 


1 


5 


28 


6 


29 


6 


6 


150 


X 


X 
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Table 3 (cont^d) 
Characteristics of the Schools Participating in the Evaluation 



Class Characteristics Program Characteristics " Teacher Ch aracteristics 



Prov, 



Exp. Days French Min. of 

or Class Class in Periods French f 

Board School Con. SES Grade Size Grade Size Cycle per Cycle^ per Cycle Exper. 



Special. Franco. 



4 


• 7 


24 


E 


2 


7 


23 


8 


28 


- 5 


15 


450 


X 


X 


4 


7 


• 25 


C 


2 


7 


23 


8 


28 


5 


15 


450 


X 


X 


5 


8 


26 


E 


2 


5 


25 


5 


19 


'5 


5 


125 


X 


X 


5 


8 


27 


C 


2 


5 


27 


5 


30 


5 


4 


100 


X 


X 


5 


8 


28 


E 


5 


5 


17 


5 


19 


5 


5 


100 


X 


X 


5 


8 


29 


C 


5 


5 


. 31- 


5 


13 


5 


4 


85 


X 


X 


5 


9 


30 


E 


5 


7 


28 


8 


31 


7 


6 


240 


X 


X 


5 


9 


31 


C 


5 


7 


31 


8 


31 


7 


6 


240 


X 


X 


5 


~ 9 


32 


E 


5 


6 


37 


6 


37 


5 


5 


100 


X 


X 


5 


9 


33 


C 


5 


6 


21 


6 


23 


5 


5 


100 


X 


X 



I 

to 

I 



X 
X 



SES: 

1 = Small Town/Rural 

2 = Urban Middle Class 

3 = Urban Upper Middle Class 

4 = Urban, Inner City, M*iddle Class 

5 = Suburban,, Middle Class 
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Development o£ Instruments and Training Interviewers 

As noted previously, several data collection procedures were designed 

specifically for this study: , 

1. A student background questionnaire-, designed to obtain 
information about age, sex, grade, etc. of each student 
in the sample 

2. An English interview 

3. A French interview 

4. A classroom observation schedule 

Copies of these instruments and instructions for their administration 

appear in Appendix A. 

The interview and observation schedules were developed after the site . 
visits to recruit schools had been made. During these visits, the project 
officer had occasion to observe several core-French classes. It became 
apparent during these observation sessions that the French interview would 
have to be undemanding, because of the level of French used in first- and 
second-year core-French classes. 

Drafts of interview and observation schedules were pilot-tested in four 
classes in two schools in the Toronto area. Several revisions and additional 
trials of the instruments were required to obtain the final versions pre- 
> sented in Appendix A. The interview had to be made short enough to be 
completed in approximately 20 minutes (the time available for interviewing 
one student). The observation schedule had to include categories for 
coding classroom behavior that were both meaningful and" usable. 
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The "tontent of the English and French interviews was analysed for 
acceptability in relation to the curriculum of the core-French programs of 
the provinces and school districts within provinces that participated in 
the study. Also, most of the French coordinators in the participating 
boards and provinces reviewed the interviews and approved their use in the 
study. 

As the instruments were being put in final form, interviewers were 
being recruited in each of the provinces involved in the study.' All of 
the recruits--three men and two women- rwere qualif-ied teachers- of French. 

In order to standardize the collection of data as fully as possible, 

the recruited interviewers — each of whom doubled as an observer — sfttended 

a three-day training session in Toronto. They first practised administering 

the interview schedules by interviewing one another and criticizing one 

another^s efforts under the supervision of the pxpject officer. Practice 

in completing the observation schedule was given by having the recruits 

view films and listen to related audiotapes of French classes. In addition^ 

the interviewers, were able to obseirve in two cere-French classes and to 

interview at least one student. The results of these observation and inter- 

♦ 

view sessions were analysed and discussed in order to develop a shared under- 
standing of^^the procedures to be followed and the meaning of the ratings to 
be made. 

Testing and Observation Procedures 

During the month of April 1980, a contact person in each participating school 
was sent the proposed schedule of visits to the school by the interviewer and 
informed that the student background questionnaires and lEA tests were being 
sent under separate cover. At the earlier site visit by the project officer, 
it had been agreed that the French teachers in each school would administer 
the background questionnaire to their students as soon as convenient after 
it had been received and that they would administer the lEA test between 
the 15th and 30th of May, on a day when the interviewer would not be in the 
school. 

The interviewers were scheduled to visit the schools between May 12 
and June 10, 1980. The procedure was to telephone the contact person in 
the interviewer's assigned schools at least two days before the visit to 
confirm that he or she was expected, and to make last-minute adjustments 
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where necessary. Once on site, the interviewer performed the tasks as out- 
lined in The Interviewers' Check List (see Appendix A). 

Class observations and teacher interviews were fitted into the school 
schedule as best they could be. The work schedule was so tight that some 
target classes could not be observed during the school visits. 

The students were withdrawn from classes and met the interviewer in 
a quiet location. First, the interviewer gave a brief explanation of the 
study and assured the student that the" interview results would have no 
bearing on his or her school marks. No mention of Monitors was made; 
indeed, the interviewers^ were not even told which of the schools- they were 
visiting had had Monitors. Next, the interviewer asked the questions, on 
the English interview schedule. " It was given first to accustom the student 
to the interview format and to give time to biiild rapport. After all the 
questions on the English interview had been answered, the interviewer told 
the student ,Cin English) that he or she would be asked a series of questions 
in French. The student was instructed to answer each question in a complete 
^sentence if possible, and to give the best possible response to each 
question. 

Once the interviewers had completed all their assigned tasks in one 
school, they moved on the next. 
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5. MEASURING THE MATCH BETWEEN SCHOOLS- 
COMPARING STUDENT CHARACTERISTICS" 



J 

Whon the study was designed each Monitor school was 'watched with a Control 
school, using characteristics of -schools, core-French programs, and teachers. 
Th> closeness of the match that was achieved in these three respects has 
Jilready been described. 

The purpose of matching was to obtain two very similar samples of 
students, one that had interacted with a Monitor and another that had not. 
The objective was that the samples should also be comparable with respect 
to characteristics such as age, sex. grade in, school, intelligence, vocabu- 
lary, reading ability, and the grade level at which the student had started 
to study French.' Other characteristics on which comparability was sought 
were whether a student had studied French outside school, whether someone 
in the student's home spoke a language other than English (and if so, what 
that language was) and whether the student spoke a language other than 
English while at home (and if so, what that language was). 

• An attempt was made to collect information on all these characteristics. 
School records were searched for scores on tests of intelligence, vocabulary, 
and reading ability and students who participated in the study were admin- 
istered a questionnaire (see Appendix A) . 

The association between school type (Monitor vs Control) and each item 
of the questionnaire was examined separately for the samples of students 
drawn from the pairs of matched classes in each pair of matched schools; 
there were 16 such pairs of ,schools-32. pairs of classes-plus one Monitor 
school for which the matched Control school had withdra-m from the study 
at the last minute. "no investigation could be made of intelligence. 
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vocabulary, and reading test scores because this information was available 
for relatively few of the students, and then on a variety of tests. For 
all other variables, except for responses to the question whether French 
was being studied outside school, information is ^presented in a series of 
tables in Appendix C. The tables for most variables consist of simple 
cross-tabulations. The tables for age give- means and staridard deviations 
of age distributions (age was measured in months) . There are no tables . 
for responses to the question about the study of French outside school 
because all students reported that their o\ ly study of French was in 
school--a necessarily perfect match. , ^ 

The closeness of the match between the students chosen from, the paired 
Monitor and Control classefs varied to some extent with the variable used to 
measure it. For grade level the match was perfect. The matches for ability 
rating and sex were very good; the match was perfect for 18 of 32 class 
pairs with respect to ability rating and for 14 of 32 class pairs with 
respect to sex. These results are to be expected, given that paired 
classes were in the same grade and that students within each class were 
stratified on sex and ability rating before the sample of students to be 
interviewed was chosen. That there was a difference in the distribution 
of students by sex and ability rating for a number of class pairs--the 
difference consisted of only one student being out of place for half of 
the pairs that were different in one or the other or both of th^se 
variables--is a consequence of having too few students in a particular 
stratuni in a schopl or of absenteeism on the days that the interviews were 
held (replacement students did not always match the sex and ability-rating 
specifications) . 

The other variables used to measure the closeness of the match between 
samples had not been used to stratify students, hence the match on these 
variables need not have been close. And yet for at least two variables it 
was. When compared by mean age, there was no consistent difference between 
paired class samples across the 32 pairs. Moreover, when compared by the 
grade in which the study of French was begun, all but eight pairs of class 
samples were found to match perfectly, and these eight differed by at most 
one student. 

The largest number of discrepancies were found for two variables 
beyond the contractor's control. Over 100 students reported that someone 




.31- 



at homo spoke a language other than English; the pattern of differences 
between the paired class samples on this variable was complex. Also com- 
plex \^a? tfie pattern of -differences for these students in Whether it was 
French or another language that was spoken instead of English, The paired 
class samples also differed, but to a less important extent, on the 
student's speaking a language other than English while at home. Only 32 
said that they did, and differences among paired class samples were 
scattered on thi^ variable* In Saskatchewan, Prince Edward Island, and 
Nova Scotia, the :Jamples were satisfactorily balanced (see, e.g. Appendix 
Table C) . ^ 

. It is difficult to judge how much effect these differences between 
/paired, class samples might have had on the lEA test results and the scoros 
/ derived from the French and English interviews. They can be expected to 
/ have added to the error variances used to judge the significance ,of the 
I effects of interest in the analyses of variance reported lat^r. The con- 
/ sequence of this should be to make the significance tests less sensitive 
I than they would have been had the match been closer. Nevertheless, match- 
I ing was so close on all the variables used to measure it that "when the 
i data were aggregated over types of schools within provincels and then over 
I provinces, no association was found between type of school attended— 
1 Monitor vs Control--and any of these variables. This suggests that the 
j overall effect of Monitors in the analyses of variance reported later was 
estimated without any biasing effects cauced by student samples. 
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6. DATA ANALY$I$r-$\UDENT VARIABLES 



As finally realized, the design for the data ^llections can be described 
as in Table 4. Within each provinc.e there wet^ pairs of schools, one of , 
which had been served by" a Monitortiffd the other (a comparable schoolO not.- 
In-Prince Edward Island there were lix' pairs, Xn Saskatchewan four, and in 
Ontario -only ^ one. One comparison sch6ol in Manitoba had to withdraw at the 
last minute, leaving a gap there. . \ j» . 

Within each school there were .two classes, the grade Wei being note4, 
within each cell of Table 4. In every instance, classes ^th Monitors .were 
compared with classes without at the j;ame grade level, and the. classroom 
was the smallest unit served independently by a Monitor. The statistical 
analysis, therefore, was structure^ to reflect- the hierarchical nature of 
the design-students within classes within paired schools and schools 
within provinces. 

The analysis model and implications for significance tests are d^is- . 
played in Table 5, and subsequent analyses of variance follow this pattern.^ 
The utility, if not necessity, of such a- complex model, was borne out by the 
analysis, which revealed that schools and classes were significant sources' 
of.variation. If not separately estimated and used properly in error terms, 
the resulting analysis would be suspect. 

Only Saskatchewan, Prince Edward Island, and Nova Scotia were included 
in the analyses of variance for two main reasons. First, the others had \ 
very few schools and thus,, contributed very few relevant compari^ns.- The ^" 
necessarily full analysis could not be carried out if they were included. 
Second, the Ontario classts scored considerably higher on the listeniiig' 
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Table' 4 

Schematic Description of .Provinces , Schools within Provinces, 
and Grades within Schools Involved in the Evaluation 
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Note : Numbers in cells are grade levels of classes. / 

Six levels per class, except two pairs have thi;ee students per class. 



Table 5 



Analysis o£ Variance Mode^l and Derivation of Error Terms for Use in Analysis of 
Variables from the Structured Interviews in Three Provinces^. 



Syrfcol 


Source and Type 


df 


Expected Mean Squares 


Error Term 


Province Effects 






t 










P 


Province (Fixed) 


2 


«2 + 


1Arr2 
lOOp 






S:P 


S:P 


School/Prov. (Random) 


11 


a2 
w 






2^C:SP 


C-.SP 


C:SP 


Class/ocn. + Prov, [Kanaomj 


1 A 

14 


a2 
w 




+ 


2^C:SP 


w 


Monitor effects 
















M 


Monitor vs. Control (fixed) 


1 


w 




* 2°MS:P " 


MC:SP 


MS:P 


MP 


Mon. X Province 


2 


a2 + 
w 




2°MS:P * 


°MC:SP 


MS:P 


MS:P 


Men. X Sch./Prov. 


11 


w 




2c^MS:P* 




MC:SP 


m:SP 


Mon. X Class/Sch. + Prov. 


14 


a2 
w 




+ 


°MC:SP 


W 














« 


W 


Within Class 


268 


a2 
w 











Note: See Table 4 for description of nested design. 



See, e.g. Winer (1962, pp. 191-195). The provinces were Saskatchewan, Prince Edward Island, 
and Nova Scotia. 



comprehension test (see Figure 1), supporting reports that Ontario students 
were in an "extended^* program. Data from all provinces are covered in the ' 
results and discussion sections; only the analysis of variance is based on 
a reduced sample. 

^^Finally, multivariate techniques were required to provide valid 
statistical tests when there were numerous, correlated dependent measures. 
As noted in a previous section, five ratings of French competency were 
derived by the Interviewer from each interview. As would be expected, 
these are highly .lorrelated, and under such circumstances a multivariate 
* test is the most powerful way to use all the. data. The ^'Multivariance'' 
compute^* program (Finn, 1977) could accommodate the double nesting, unequal 
N;s, and different error terms in a* multivariat,e, janalysds.-- The variance 
analyses and statistical tests for Monitor effects are supplemented by 
exploratory and descriptive analyses ♦ 

The four scores derived from the 23 items- of the French interview 
(failurcij to~respdnd7~correct responses , number of prompts7 anci^s^um of 
quality ratings) 'were subjected' to the same analysis as the variables in 
Tables 5 to 9, with a null result. Distributions of school means are 
displayed in Figure 4. Though each difference in median school average favors 
the Monitor group, these differences are not significant individually, or by 
the multivariate test. Neither were there differences between Monitor and 
Control groups on responses to item 18. 

The three slicited imitation tasks yielded two scores, total unit 
responses and total number correct. The distributions of school means in 
Figure 5 leveal ahnost identical median scores and school mean spreads that 
might easiJiy arise by chance from the same population* 

Data Analyi^is- -Observation Variables 

Although 6b classes were involved in the study as a whole, only 52 classes 
were observed. Among these there were 21 pairs of classes, each pair 
consisting ff a class from a Monitor school and one at the corresponding 
grade level from the matched Control school. The 21 pairs of classes were 
drawn from 12 pairs of schools. Nine pairs of schools were each repre- 
sented by two classes, three pairs by only one class. The ^analysis was 
restricted to the observations made of these 21 pairs of classes. 

Most classes were observed only once. Six classes among 21 pairs were 
observed twice. The two observation records for these classes were averaged 
to obtain a single record. 



The observation record for a, class yielded the following variables: 

1. Total number of different questions asked by the teacher in the 
expectation of a response 

2. Number of questions answered by the class as a whole (as distinct 
from questions answered by individuals) 

3. Number of correct responses 

4. Number of incorrect responses 

Number of questions to which n9 response was given 

6. Number of responses in English (when French was expected) 

7. Number of prompts (from'the teacher) to elicit responses 

8. Number of prompts to correct responses 
Number of prompts in English 

10. Number of times the teacher moved to another student for a response 

11. Number of times the teacher used English 

12. Average quality rating assigned responses in French. 

—The frequency of number of occurrences of variables 2 through 11 in the ^ 
preceding li§t seemed inappropriate for further analysis. They depend to 
some extent on the magnitude of variable 1, the total number of questions 
.asked by the teacher. To correct for this problem, variables 2 to 11 were 
converted to proportions by dividing them by variable 1. It was the propor- 
tions for these variables that were subjected to further analysis. 

The statistical analysis of the observation data consisted of treating 
each pair of classes as one unit of observation. Tlie differences between 
paired classes for each observation variable were obtained. , A correlated 
t test was applied to the distributions of these differences to test the 
null hypothesis that the mean difference for each variable was zero in the 
population. 

The correlated t test that was used in this analysis is possibly 
inappropriate. One reason for suggesting that is that it ignores the fact 
that the 21 pairs of classes are not all independent; there are two pairs of 
classes from each of nine pairs of schools. One way to circumvent this 
problem is to obtain averages over pairs of classes within pairs of schools/ 
thus treating the school pair as the unit of analysis and reducing the 
number of units to 12. This was done and the analysis was repeated. 



7. RESULTS 



-I 



Student Variables 

The measures included language proficiency or competency (from the French 
interviews and the lEA Listening Test) and the group concerned with • 
attitudes, knowledge, and experience in French (from the English interview). 

Table 6 contains results of analysis of the lEA test scores. The 
distributions of Monitor and Control school means are displayed in Figure 1, 
showing clearly the extreme (but comparable)^ Values obtained in the two 
Ontario schools and the slight difference between Monitor and Control 
schools that our analysis tells us is well within the bounds of chance 
variation. 

The summary of MANOVA results for th^ five competency ratings from the 
French interview is presented in Table 7. As noted above, only the omnibus 
multivariate test is presented because of the high positive correlations 
among the ratings (see Appendi^c D, Table Dl) . Analysis of th6 other five 
competency or proficiency scores is siimmarized in Table 8. Table 9 is a 
parallel table for the attitude, knowledge, and experience variables derived 
from the English interview. The model for the analysis in Tables 7, 8, and 9 
was presented in Table 5. 

~ Figure 2 displays distributions <^f school means on the five competency 
ratings, showing that students ip the Control schools were rated by the 
Interviewers as slightly more competent than students, in the Monitor schools 
(per significant Monitor effect. Table 7). No other significant Monitor 
differences were found on competency or proficiencV scores. 
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Table 6 

^ Analysis of Variance of TEA Listening Comprehension Data from 
Saskatchewan, Prince Edward Island, and Nova Scotia 



' Sources 


ur 


Me 
Mo 




P 


Province Effects 










Province 


2 


735.82 


10.74 


.00 


School/Prov. 


11 


68.53 


1.21 


.21 


Class/Sch. + Prov. 


14 


56.71 


4.25 


.00 


Monitor Effects 










Monitor vs. Control 


1 


1.05 


.02 


.89 


Mon. X Prov. 


2 


9.26 


.18 


.83 


Mon. X Sch./Prov. 


11 


49.92 


2.62 


.05* 


Man. X Cl./Sch. + Prov. 


14 


19.03 


1.43 


.14 


Within Class 


265 ^ 


49.92 







Statis-cally significant 
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lEA Listening Comprehension Test 



27 .. 



23.. 



19 .. 



15.. 



11 .. 



17 



Monitor 



O 



Control 



0 



Ontario 
schools 



75% 
50% 
25% 



Fig. 1. 



Distributions of 33 school means (17 Monitor and 16 
Control) from all five provinces: Horizontal line marks 
the median, box includes the middle 50% of school means, 
dots mark minimum and maximum observed means. Circled 
dots mark exceptionally extreme values (outliers) that 
have been set aside for calculation of the median and 
quartiles (box) . 
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Table 7 

Multivariate Analysis Variance Results for Five Conpetency Ratings' 
from the French Interviews in Saskatchewan, Prince Edward 
Island, and Nova Scotia 



Sources 


df 


2 

F 


f 

p 


Province Effects 








Province 


10;55 


2.85 


* 

.04 


School/Prov . 


55;70 


2.71 


■ .01 J 


Class/Sch. + Prov. 


70; 1261 


1.05 


.38 


Monitor Effects 








Monitor vs . Control 


5;7 


5.37 


.02 


Mon. X Prov. 


10;14 


1.53 


.23 


Men. X Sch./Prov. 


55;50 


1.47 


ns 


Mon. X Cl./Sch. + Prov. 


70;1261 


0.95 


.59 


Within Classes 


1261 


\ 





Pronounciation, Fluency, Grammar, Vocabulary, Comprehension 
^Multivariate F^, five variables, df vary with effect and error term. 

k 

Stati^stically significant ' 



Highly statistically significant 
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Table 8 



Multivariate Analysis of Variance Results for Five Variables 
' Derived from the French Interview- -Items 1-27^ 



Sourtes 



df 



Province Effects 
3 

Province 

3 

\ School/Prov. 

\^ 

\piass/Sch^. + Prov. 
Monitor Effects 

Monitor vs. Control 

Mon. X Prov. 

Mon. X Sch./Prov. 

Mon. X Class/Sch. + Prov< 
Within Classes 



70; 1261 

5;7 
10; 14 
55;50 
70; 1261 

1261 



1.54 

0.98 
O.VO 
1.85 
1.71 

-I. 



.00* 

49 
71 

01'' 



00 



^No. of failures to respond, no. correct, completeness of correct response, 
no. of prompts (except item 18), no. of units correct (Item 18) 

^Traced primarily to one school in one province (see Appendix D, Table D4 
for details) 

^Province and iichool-within-province effects were net estimated in this 
analysis . 



" Highly statistically significant 



Table 9 



Multivariate Analysis of Variance Results for Four Non- linguistic Variables 
Derived from the English Interviews in Saskatchewan, 
Prince Edward Island, and Nova Scotia 

9 V " 



Sources 


d£ 




P 


Province Effects 








tv^ » 3 






• 


School/Prov. 








Class/Sch., + Prov. 


56; 1032 


1.77 


.00** 


Monitor Effects 








Monitor vs. Control 


4-8 


3.79 


.05* 


Monitor x Prov. 


8; 16 


0.71 


.68 


Mon. X Sch./Prov. 


44; 44 


4.07 


.00** - 


Mon. X Class/Sch. + Prov. 


56; 1032" 


.98 


.51 


Within Classes 


1032 







Attitude to French, Knowledge of French Culture, Quality of Experiences, 
Quantity of Experiences 

2 

Multivariate F, four variables, df vary with effect and error term. 
Univariate tests can be made from results given in Appendix D. 

3 . ^1 
Province and school- within-province effects were not estimated in this 
analysis 

* 

Statistically significant 
** 

Highly statistically significant 
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* Comoetency Ratings from the French Interview 



Pronunciation 



Monitor Control 



Fluency 
Monitor Control 



Gramroar 



Vocabulary 



. Monitor Control Monitor Control 



Comprehension 
Monitor Control 
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.5 
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t 

4^ 
cn 
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\ 



Fig. 2. Distributions of 33 school means (17 Monitor and 16 Control) 
from all five provinces: Horizontal line marks the median, 
box includes the middle 50% of school means, dots mark 
minimum and maximum observed means. 
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The significant Monitor effect on variables from the English interview 
(Table 9) can be seen in Figure 3. Students in Monitor schools showed better 
attitudes^ mbre knowledge of French culture, and reported more and better, 
experiences, in French class. 

Observation Study 

The results of the Observation study revealed no important differences 
between Monitor and Control classes on any of the observatioii^variables . 
(The distributions of differences for the 21 pairs of classes on the 12 
observation variables are presented in tables in Appendix E.) The null 
hypothesis of zero mean difference was rejected for only one variable, the 

proportion of times during an observation session that students g^ve no 

\ 

response at all to a question ( t^ = 2.32, df = 20, p > .05). The mean 
difference in proportions favored the Control classes by 0.02, which is to 
say)that, when asked a hundred questions. Monitor classes like those in this 
study would be expected not to respond to two more questions than the 
corm^^onding, paired Control classes. This expected difference must be 
evaluated against the average proportions of times that students in both 
types of classes failed to respond to questions. These proportions were 
small--0.04 and 0.02 for Monitor and Control classes, respect ively--and seem 
to reflect nothing of educational significance. 

The analysis of the observation variables was repeated using paired 
schools as the unit of analysis. The results were substantially the same 
as for the analysis of data from paired classrooms. ^ 

It must'^be concluded that no evidence was found in iihe observation 
variables of important differences between Monitor and Control classes. 
This conclusion is based on the 21 class pairs (five provinces) included 
in this analysis, and generalizes to these school pairs. 
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Scores Derived from the English Interview 



Attitude to 
French 

Monitor Control 



Knowledge of French 
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Monitor Control 
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\ag. 3. 



Distributions of 33 school means (17 Monitor and 16 Control,) from 

all five provinces: Horizontal line marks the median, box includes 

the middle 50% of school means, dots mark minimum and maximum 
observed means . 




8. DISCUSSION 



To the contractor, the most striking pattern in all the outcomes was the 
similarity between Monitor and Control groups. The matching of schools and 
balancing of samples had produced two groups that, in the contractor's 
►judgement, were more alike overall than two random samples would have been. 
Some differences were found, as noted in the previous section and discussed 
below, but the strong result is similarity. 

Given that half of the schools had been served by a Monitor for much 
of the year (though we don't really know how much Monitor time they got), 
this similarity also implies that the aggregated impact of the Monitors, 
the effects averaged over 12 students per sichool, could not have been large. 
Arguments were advanced in the first section of this report why expectations 
for Monitor effects should be modest, and such expectations would seem to 
have been justified. 
Competency and Proficiency 

Consider first the scores on the lEA Listening Comprehension lest. The range 
and size of scores indicated that the test was suitable for all schools, with 
the possible exception of the two Ontario schools, where the test was too 
easy. Contrary to reports during our survey, the French program in these 



■^This is a .subjective judgement based on many .years of experience with 
data from comparative experiments. Researchers preoccupied with differences 
(including the present authors) rarely report on similarities, and time did 
not permit a thorough exploration of this conjecture. 
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schools could not be described as a core program (as that term is used in 
this study), in that French was studied for 40 minutes per day--about twice 
the time spent by students in other schools. 

Monitor schools overall had a higher mean (and median) scores but 
variation among classes and schools (excluding Ontario and Manitoba) .was 
large enough that the difference could easily be due to chance (see Table 6 
and Figure 1). If we use this international standard, the data support a 
conclusion of no difference. 

The lEA test was perhaps the sternest test of the students' ability to 
understand spoken French. The voices (in standard French) emanated from 
tape recorders of varying quality, with none of the visual or contextual 
clues that a listener has when speaking face to face. The listening task 
resembled very little the encounters between Monitors and students described 
to the contractor by teachers and coordinators. The lEA test was seen by 
the contractor as a benchmark, not very likely to be affected by Monitors 
but useful in view of the untried nature of the other measures. Had the 
survey and sample selection not taken so long, the lEA test would have been 
given early in the year and used (as a covariate) to reduce error variance 
and, if necessary, to equate the groups by statistical means. 

The Interviewers, on the other hand, rated the Control groups higher 
than the Monitor groups on the five characteristics, pronunciation, fluency, 
grammar, vocabulary, and comprehension, and the difference cannot be readily 
attributed to chance (see Table 7, Figure 2, and Appendix D, Table D2). 
These ratings should be regarded as one global rating, as noted previously. 

Before we discuss the global Interviewer ratings further, consider the 
last set of competency scores, those derived by summing rated responses to 
25 of the items of the French interview (responses to short questions). The 
results for failure to respond, number of prompts, number correct, and 
quality/completeness (see Figure 4) were all in favor of the Monitor groups, 
though not to a statistically significant extent. These scores are also 
highly correlated and can be viewed as a different sort of measure of 
another dimension of competence, especially (recalling the provincial 
coordinator's words) whether Monitors succeeded in "loosening the tongue. 
The distributions o'f scores derived from the three elicited imitation tasks 
(Figure S) were very similar in the two groups. 

5.7 



Scores Derived from 23 Questions of the French Interview 
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Fig. 4. Distributions of 33 school means (17 Monitor and 16 Control) 
from all five provinces: Horizontal line marks the median^ 
box includes the middle 50% of school means, dots mark 
minimum and maximum observed means. Circled dots mark 
exceptionally extreme values (outliers) that have been ^et 
^.J aside for calculation of the median and quartiles (box). 
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Scores Derived from the Elicited Imitation Tasks 
Items 28-30 of the French Interview 



No. of Responses Attempted 
Monitor Control 



No. of Correct Responses 
Monitor Control 



9 



8 



7 



6 



5 



c 



Fig. 5. Distributions of 33 school means (17 Monitor and 16 
Control) from all five provinces: Horizontal line 
marks the median, box includes the middle 50% of 
school means, dots mark minimum and maximum observed 
means . 
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That these competency scores do not confirm (may even contradict) the 
global ratings, complicates the interpretation of the data. Recall that 
these competency scores showed high internal consistency reliability, 
indicating that together they measure some characteristics in a stable 
fashion. Before we probe the inconsistency of competence results, a few 
commen-^s on the qualitative responses are in order. 

Attitude, Culture, Experience 

Monitor groups showed more positive attitudes and more knowledge of items 
o£ French culture, reported more experiences in French, and achieved a 
higher quality of experience score than the Control groups (see description 
of English interview for scores and Figure 3 for results). The differences 
are significant (Table 9), traceable mainly to the quantity and quality of 
experiences in French class. 

The size and consistency of these results on variables that are 
aggregates of large numbers of responses are strong support for attributing 
the differences to the work of tho Monitors. Students in these schools do 
not have opportunities outside school to meet French speakers and to learn 
systematically about French culture. In general, inside school and out, 
apart from the Monitors, the students in both groups had the same (minimal) 
opportunities . 

Exploring the Inconsistent Results on Competence 

The Interviewers rated the Control groups higher than the Monitor groups by 
their judgements made at the end of the French interview. When analysed 
apart from other measures, the differences were significant. These global 
ratings did not agree with the objective counts derived by summing ratings 
on individual items of the French interview, including the summation of the 
Interviewers' judgements of quality for each item of the interview (Figure 4, 
Quality of French Responses). In other words, the Interviewers' own judge- 
ments, item by item, added up in favor of the Monitor groups, whereas their 
summary judgements favored the Controls. 

One question posed was, "Do Monitors 'sensitize the ear'?" The compre- 
hension rating and the scores, number of Failures to Respond, and Number-of 
Prompts were designed to help answer this question. Fewer prompts were 
required by students from Monitor classes and there were fewer failures to 
respond. The skewed and stretched out distributions, especially on prompts, 
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indicate that one cannot rely entirely on traditional statistical tests 
when faced with puzzling results. 

Examining ,the comprehension ratings presented in detail in Table 10, 
one is struck with the low level of performance reflected by this and all 
ratings. Students in the first few years of core French develop very little 
competence, however defined. The observed rating difference in favor of the 
Control group apparently comes from both a few more low ratings in Monitor 
groups and one or two more middle ratings in Controls. 

One hypothesis always present wlien people make subjective judgements 
(such as the ratings) is that there is unconscious bias in favor of one or 
the other groups under study. The training of Interviewers in this study 
has been described and it will be recalled that they did not know in advance 
which schools did and did not have Monitors. After reading Interviewer 
comments and hearing their verbal i:eports, we were quite confident that 
results were not affected by any tendency of Interviewers to favor one 
» group over the other. The inconsistencies forced us to reexamine this 
possibility. 

In two of the three provinces on which the main analyses are based, 
the Interviewers were experienced teachers. One had been a French 
coordinator. The Interviewer in the other province was a younger person, 
a very recent graduate of teacher training. The differences between 
Monitor and Control groups recorded by the younger Interviewer are all 
smaller than those recorded in the other two provinces. There is other 
evidence of difference among the Interviewers that may throw light on the 
failure of the two types of quality judgements to agree. 

Figure 6 contains a graph of global rating results, comparing Monitor 
and Control groups means for the three provinces, combining all five 
ratings. Before they were averaged over the five ratings, data on each one 
were converted to standard scores, province by province, subtracting from 
each rating the provincial mean and dividing^ by the provincial standard 
deviation. The standard scores in each province thus had a grand mean (all 
scores) of zero and a standard deviation of one. Differences between 
Monitor and Control groups, if any, were preserved, but any tendency of an 
Interviewer in one province to rate consistently higher or lower ("mark" 
easier or harder) than Interviewers in other provinces was eliminated. 



Table 10 

Percentages of Students in Each Province Receiving Various 
Ratings on the Basis of the French Interview* 



Provinces and 
Monitor vs. Control 



Across 











Prince 






Three 




Scale 




Saskatchewan 


Edward 


Island 


Nova 


Scotia 


Provinces 


Name 


Categories 


Monitor 


Control 


Monitor 


Control 


Monitor 


Control 


Monitor 


Control 


Vocabu- 


Little or none 


21 


13 


12 


7 


8 


16 


14 


11 " 


lary 


Simple basic 


23 


33 


17 


7 


31 


14 




16 ' 




Something more 


6 


4 


> 21 


36 


10 


21 


13 


23 




No command of 




















rules--mis- 


















Grammar 


communicates 


14 


20 


8 


2 


12 


14 


11 


10 




Fair 


32 


21 


16 


8 ^ 


30 


IS 


25 


16 




Good to excellent 


5 


8 


26 


40 


7' 




, 14 


. 24 




No understanding 


35 


34 


16 


7 


12 


21 


20 


19 


Compre- 


Some of slow speech 


8 


12 


12 


9 


32 


15 


17 


12 


hension 


Almost all if slow . 


6 


4 


10 


20 


4 


S 


8 


12 




Understands normally 


1 


0 


11 


13 


2 


6 


5 


7 




Fragmented, primitive 


20 


21 


9 


2 


12 


15 


13 


11 


Fluency 


Very hesitant 


17 


18 


13 


10 


24 


18 


17 


15 




Some speech flow 


13 


10 


20 


26 


13 


12 


16 


17 




Approx. normal speech 


1 


0 


8 


12 


2 


6 


4 


7 


Pronun- 


Hardly intelligible 


39 


34 


20 


8 


29 


26 


28 


21 


ciation 


Usually intelligible 


12 


15 


30 


42 


21 


24 


22 


• 29 


No. of Students (Total, 324) 


48 


^ 48 


66 


66 


48 


48 


162 


162 



For illustration of results by category, 
and in Appendix D, Table 2, 



Statistical analysis of these data is reported in Table 7 
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Figure 6. Average global competence bating (in scores 
standardized by province) for Monitor and 
Control groups in three provinces . 
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Figure 6 suggests a Monitor by Province interaction, and statistical analysis 
o£ these standard scores provides .some support (£= .08). • ^ 

•One explanatioYi for this interaction is that the different Interviewers 
actually applied different criteria in rfeaching their judgements, in- spite 
of the efforts during training to standardize via definitions of fluency, 
comprehension, and so on. The higher ratings given to Control group 
students, especially by the experienced Interviewer in Province 3, may 
indeed document a monitor effect to which that Interviewer was .Jiighly 
sensitive— students who work with Monitors may become less li|?.e the, usual 
core-French student. Their pronunciation may be non-standard,^ and therefore 
Hess attractive to Interviewers accustomed to "school French." . ' ^ 

Research completed after the Monitor evaluation was begun suggested 
that age and language background can affect the judgements listeners' make 
of French spoken by Anglophone students. Lepicq (1980)' studied the accept- 
ability of French spoken by 12-year-old immersion students to uni lingual 
and fully "bilingual "judges," half of^ whom were 12-year-olds and half of 
whom vere adults. Both age and degree^ of bilingualism affected judgements, 
in many .ways too complex to go into here, but it was found that youqger 
judges and bilingual judges were more tolerant. Since the cWtext was "t^ 
different from the Monitor evaluation, such a study mainly sensitizes us 
to the likelihood of. unwanted Interviewer effects. Had these results been 
available more effort would havp been devoted to matching ages and back- 
grounds 'of Interviewees. 

It is also possible that Monitors "sensitize the ear," but that they 
do so selectively with those beginning students and that there wasn't time 
for the sensitivity to mature and generalize to other speakers. On measures 
of willingness to respond and completeness of correct phrases. Monitor 
students were at least equal to the Controls. - 

If Interviewers in different provinces were using different criteria, 
there might be different patterns of correlation among the variables. 
Table 11 contains correlations £imong the five ratings, eight quality ^ 
juclgements derived from the items on the French interview and the lEA 
Listening Comprehension scores, calcu-lated separately for each of the three 



provinces. 

The French -quality •variables correlate moderately highly with ratings 
and lEA only in Province 1 (where the yojjnger Interviewer worked). In the 
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Table 11 

Within-Province Correlations Among Competence Measures 
Values Less than 0,20 and Decimal' Points Have Been Omitted 



Province 1 





Item Level 




^Ratings 




No. Cr. Qual. 

23 23 
Items Items 


No. 

3 

Sits 


Cr . Qual . 
3 

Sits 


No . 

Rep. 

E.I. 


No. 
Cr. 
E.I. 


No. Cr. Qual. 
Item Item 
18 18 


lEA 
List. 
Comp . 


Pro^. 


Fluency Gram. 


Vocab. 


Qual. 23 


83 


















\ 






No. Cr. 3 ■ 


























Qual'. 3 


46 


55 


23 




















Rep. E.I. 


25 


32 




29 


















No. Cr. E.I. 


55 


48 


29 


37 


















No. Cr. 18 


29 


39 




22 














V 




Qual. 18 


39 


37 


21 


22 






58 












lEA 


57 


52 


22 


23 




36 




30 


100 




Pron. 


48 


43 


28 


30 




53 






39 








Fluency 


54 


53 


22 


37 




41 


36 


33 




57 






Gram. 


52 


43 


43 


' ' 26 




36 




21 




56 


53 




Vo cab . 


63 


58 


37 


53" 




39 




21 




50 


59 52 




Comp. 


68 


64 




32 




37 


34 


29 


53 


60 


57 50 


55 



I 

tn 
00 
I 



i J 



si 
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Province 2 





Item Level 




Ratings 




No. 


Qual. 


No. 


Qual. 


No. 


No. 


No. 


Qual . 


TC A 

IcA 










'23 


23 


3 


3 


Rep. 


Cr. 


Item 


Item 


List, 










Items 


Items 


Sits. 


Sits. 


E.I. 


E.I. 


18 


18 






Pron. 


Fluency Gram. Vocab. 


Qual. 23 


93 
























No. Cr. 3 


61 


56 






















Qual. 3 


68 


74 


72 




















Rep. E.I. 


46 


46 


35 


44 












t 






No. Cr, E.I. 


83 


78 


59 


64 


58 














No. Cr. 18 


66 


61 


42 


42 


27 


58 










* 




Qual. 18 


56 


61 


40 


56 


24 


51 


58 












lEA 








Pron. 


21 




24 






21 


24 




46 ■ 








Fluency 


















41 




76 




Gram. 


24 


20 


26 








22 




50 




78 


83 


Vocab . 


27 


23 


29 


21 




22 


20 




46 




76 


77 85 


Comp. 


33 


25 


31 


24 




22 


22 




42 




82 


78 - 82 84 
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Province 3 





Item Level 




Ratings 




No. 

23 
Items 


Qual. 

23 
Items 


No. 

3 

Sits. 


Qual. No. 

3 Rep. 
Sits. E.I. 


No. 
Cr. 
E.I. 


No. 

Item 
18 


Qual . 
Item 
18 


lEA 
List. 
Comp . 


rron. riuency brajn. vqcod. 


Qual. 23 


93 


















No. Cr. 3 


74 


76 
















Qual. 3 


70 


77 


79 














Rep . E.I. 


51 


55 


43 


52 












No. Cr. E.I. 


77 


78 


73 


73 54 












No. Cr. 18 


63 


65 


54 


51 20 


57 










Qual. 18 


54 


62 


61 


69 21 


60 


66 








lEA 


-25 






Pron. 


-32 


-28 


-26 


-23 








62 




Fluency 








-20 








62 


78 


Gram. 








-22 








59 


70 79 


Vocab. 


-28 


-29 


-32 


-32 


-29 


-27 


-27 


56 


72 82 80 


Conip. 








-20 






-20 


62 


74 81 81 80 



'7 J Note: Values less than 0.20 and decimal points have been omitted. 
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other two provinces, correlations of ratings with lEA are high, but 
correlations of ratings with Frencli quality scores are low, even negative 
(all correlations in the table are significantly different from zero) . 
Interviewers in Provinces 2 and 3 certainly appear to have meant somet;hing 
different when they marked each item than they did when they made global 
ratings at the end of the interview. Factor analysis of the three 
correlation matrices in Table 11 (see Appendix D, Table D3) revealed a 
sharp and clear separation between the French quality variables and the 
others in Provinces 2 and 3, but substantial overlap, and one more factor, 
in Province 1. 

By now it is clear tha^ there is no simple answer to the question, did 
students in contact with Monitors perform better than Controls in the French 
interview? In an attempt to bring all the results from the measures of 
French competence together, one final summary' analysis was performed accord- 
ing to the model in Table 5. 

Four variables were involved: the global ratings were aggregated into 
a single score. The sum of the quality/ completeness ratings for all 30 i 
items of the French interview was calculated (see pages 13-14: variables 
3, 7, 10, and 11). Also, a total was obtained for the number of correct 
responses to all 30 items (variables 2, 6, 9, and 12). The IbA Listening 
Comprehension Test was also included. 

The summar)' multivariate analysis is presented in Table 12, and the 
parallel univariate analyses in Appendix D, Table D4 . Neither the multi- 
variate test of all four variables nor the univariate test for the sum of 
the ratings indicated a significant Monitor effect or Monitor by Province 
interaction. The significant Monitor by Class interaction is evidence that 
the analysis was quite sensitive. It was possible to trace this interaction 
to the classes in one school in Province 2. In the Monitor school, one 
class was rated very well and one very poorly on both quality/completeness 
and Number of Correct Responses (see Table D4) . The two classes did not 
differ significantly on either lEA ^r the sum of the five global ratings, 
and the Control classes in the matched school were both quite average. 
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Table 12 

Multivariate Analysis of Variance Results for Three Aggregate 
Variables Derived from the French Interview^ 
Plus lEA Listening Comprehension 



Sources 


df 


F 


P 


Province Effects 








Province 


8,16 


5.66 


.00 


School/Prov. 


44,44 


4.71 


.00 


Class/Sch. + Prov. 


56,1053 


2.12 


.00 


Monitor Effects 








Monitor vs. Control 


4,8 


2.12 


. 17 


Mon. X Prov. 


8,16 


2.10 


.10 


Mon. X Sch./Prov. 


44,44 


1.49 


.10 


Mon. X Class/§ch. + Prov. 


56,1033 


1.66 


.00 


Within Classes 


1261 







1 

Quality/Completeness, Number Correct, and Sum of Five Ratings 

2 

Traced to classes in one school in Province 2 (see Appendix D, 
Table D4 for class means). 

** 

Highly statistically significant 



9. CONCLUSIONS 



In the attempt to sum up what has been learned, the first task is to describe 
the limitations on the generality of the results--to estimate how far one 
can generalize the findings beyond the sample of schools, classes, and 
students who were involved. Conclusions are then offered under the three 
main headings listed under the Purpose of the Evaluation— students ' 
competence in understanding and speaking French, knowledge of French culture, 
and attitudes toward French and French culture. As noted above (p. 16), it 
was decided to concentrate on attitudes to learning French. Observations 
in classrooms detected no differences between Monitor and Control classrooms. 

Limitations to the General izability of Results 

By the design of the study, the conclusions are limited to core-French 
classes, here defined to be classes of English-speaking students receiving 
instruction in French about 20 minutes per day, i.e. not regularly more 
than 100 minutes per week. Again by design, results apply only to 
beginning students, those in their first one or two years of French study. 
These first two restrictions and a limited budget for travel meant that 
the sample for most analyses was confined to grades 5, 6, 7, and 8 in three 
provinces. Nova Scotia, Prince Edward Island, and Saskatchewan. The 28 
schools from these provinces were atypical in at least one sense--they were 
all within 6S km of a university. 

Substantial variability was observed on all measures among provinces 
and within all provinces among schools and classes (see Tables 6-9 and 
Table 12, 'Province Effects'). The absence of significant Monitor by Province 
effects suggested consistent results across provinces, within the exception 
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of the rating differences discussed at length in the section "Inconsistent 
Results on Competence." That effect, though very weak, seemed important 
to explore, and a case was made for Interviewer differences. In other words, 
generality was limited by choice of Interviewer, not bv characteristics of 
the sample. Wherever Ntonitor by Class or Monitor by School effects suggested 
inconsistent results, hence less generality, the effect was traced to one 
or two schools in one province--not a large enough threat to generality to 
justify limitations on the conclusions. 

To sum up, the conclusions reached in this study may be applied with 
reasonable confidence to all classes like those in our sample. If general- 
izations are made to different classes within the same three provinces, 
then these generalizations should be made cautiously. 

Competence in Understanding anji Speaking French 

iVhen all analyses are taken into account, no strong^ase can be made for a 
difference in listening or speaking competence between Monitor and Control 
"groups. Controls showed higher global ratings than Monitors; the difference 
was statistically significant with the ratitigs considered in isolation, but 
not so when they were analysed jointly with the other competence measures. 
The latter analysis was seen to be very sensitive in at least one respect. 
Evidence was discovered that can be interpreted to mean that reasonable 
Interviewers disagreed on the meaning attached to the global ratings. 

^ Monitors showed higher quality/completeness and Number of Correct 
Scores when individual item ratings from the same Interviewers were combined, 
but that difference did not reach significance. Scores derived from the 
elicited imitation tasks (items 28-30), situations (ite^ns 25-27), and reading 
numbers aloud (item 18) were positively correlated with each other and with 
scores derived from the simple questions (items 1-24, except 18). Therefore, 
they were reduced to two measures, a sum of the quality/completeness ratings 
in one and a total count of number correct in another. 

In a final summary analysis (Table 12) with global ratinga, the 
standardized test of listening comprehension, the overall quality/complete- 
ness ratings, and the total number correct, no Monitor-Control differences 
were significant. If there is a strong case, it is for no difference. 
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Knowledgo of French Culture 

Validity of and limitations to the direct measure of cultural knowledge have 
been; noted (pages 15-16). The score used was a count of items of knowledge, 
and kn Figure 3 one can see that the median of the school means for both 
Monitor and Control schools! is less than one. In very few schools (all 
Monitor schools) was the average number of items of knowledge greater than 
two. 

On the other hand, students in Monitor schools recorded significantly 
more experiences in French and these were judged to be of higher quality. 
Seventy-five percent of Monitor schools recorded quality means higher than 
all but 25% of the Control schools (Figure 3) . Assigning a Monitor to a 
school is very likely to make a big difference in the number and quality 
of experiences students have in French. An increase or decrease in average 
knowledge of discrete facts is unlikely to be found. 

Attitude to Learning French 

Monitor schools had mean attitudes 4.5 or higher. The Control schools were 
not far behind, and the difference was not significant. Attitude scores 
were not significantly correlated with competence scores (hence correlations 
were not supplied). Again, as with competence scores, the data support a 
conclusion of no difference between Monitor and Control schools, with the 
comment that students in core French in these provinces (all five) seem to 
have had a positive attitude, whether or not they enjoyed the assistance 
of a Monitor. Other studies where influences might have been more powerful 
(e.g. Hanna^t £l.,1980) have found no increase in already positive attitudes 
to learning French. 
Summing Up 

Comparisons were made in five provinces between beginning core-French ^ 
students who had contact with part-time French Monitors and students -..'ho 
did not. Measures of French speaking and listening competence, cultural 
knowledge, quantity and quality of experiences in French class, and 
attitude toward the learning of French were derived from interviews 
conducted in French and in English. Students who had Monitor contact 
reported many more experiences in French class, and their experiences 
were judged of higher quality than those of Control students. In other 
respects, however, no differences of note were found between Monitor'and 



\ 
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\ 

.Control students. By virtue of the fact that they enhance the quality and 
quantity of experiences in French class, part-time French Monitors deserve 
to be called cultural ambassadors. 
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^ ' f ... 

oiSE moniJtor evaluation 

1980 

Int^rvieifver's Checklis t ' 

■ \ 

The primary purpose of your visit to each school is to interview 12 students 
selected by the teacher and to observe each of two selected classes in the 
school at least ,once. In addition, you are to meet with the French teacher 
to verify certain d;;cails of the French prograrfi in the school and to check 
on the progress of the testing phase of the study. 

You should try to contact the principal of ea&h school the day before 
your visit starts to remind him you are visiting the school. Leave a message, 
if necessary. Each principal and French teacher has been advised of the 
dates of your visit. Arrive at the school at least a half hour before classes 
start in order to have timej to introduce yourself to the principal and French 
teacher. Ascertain (a) the location you will be using for the interviews, 
(b) the ti^ne of the French classes you are to observe, and (c) whether the 
students have been advised of the times and location for their interviews. 

Be sure you have the following before going to each school: 

a. Copy of the interview questions (1) 

b. Copies of Interv"iew Coding Sheets (12 + 2 spare) 

c. Copies of Class Observation Form (2+1 spare) 

d. Cassette recorder (1) 

e. Cassette tape (1+1 spare) 

f. Class Lists 

At some time during your visit to each school you should arrange a 
short appointment with the Frfench teacher. 1 

Ask (a) If the French Listening Comprehension test ha'> been 
administered to the selected classes. If it has 
not, please remind them to do so before the end of 
May (or if it is after the end of May as soon as 
possible)* 

I (b) Ask if the Student Background Questionnaires have 
been completed-~if not ask them to do so ASAP* 




S3 



(c) Ask (a) the number c£ days in the school cycle^ 

\ i 
(if other ^han a week) and the number of minutes\ 

of French each selected class receives duiring 

each cycle; (b) the numbei^ of students inj each 

of the selected classes • | 

(d) Ask, "How do you feel about teaching French in 
j:his particular school?'* ' 

(e) 'Then ask, "How do you feel about the students 
in your French classes this year?^' 

(f) Ask, "How were the 12 students chosen fox interview?" 



Before you begin in the next school, write up a:brief description of 
your experiences. Include the information requested above in. your report. 
In your description, focus on: \ 
(a) Exceptions to the plan, if any ' \ 

\ (b) Unique features of the school. ' '\ 

Before you leave a schooj, use the summary checklist below to be sure 
you Have remembered everything: 

Interview 12 students, recording two a.ui., two p.m. \ 
I Observe in two classrooms and complete the forms. \ 
Meet French teacher and pose questions. i 
Listening tests completed? 

.Student background questionnaire? | 
, Length of school cycle and French period? \ 

Size of French class? 

Feeling about teaching French in this school? 
How were students chosen for intlerview? 
Write Jescription of visit. 
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INSTRUCTIONS TO INTERVIEWERS 

Each interview should take about 20 minutes. Ask the school to schedule 
the interviews 30 minutes apart to give you time to jot down any notes and 
to prepare for the next student. 

Be sure to mark in the identifying information at the top of each 
coding sheet. We must be able to correlate the interview with the other 
tests. 

The answers to the English part of the interview are mostly Yes, No 
or numeric answers. Simply mark the student's response on the coding sheet. 

Under the comments section, note your perceptions of the student, in 
particular his ability and willingness to answer the questions and how 
verbal and communicative he was. Also note a*->y other occurrences of 
importance. 

Any question that asks, »»How often?" is coded as follows: 

0 = never 

1 = once per month 

2 = twice f5er month 
3=3 times per month 

4 = once per week 

5 = more often than once a week 

The French section of the interview is more complex to code. Each 
response is coded on 2 scales. 

The first scale 0 1 2 X codes the response as follows: 

0 = no response 

1 = incorrect response 

2 = correct response 

X = student was prompted or question was rephrased. 
The second scale codes the quality or completeness of the response as 
follows: 

0 = no response 

1 = response wcs one word 

2 = response was a phrase 

3 = response was simple sentence 

4 = response was very complete 

As an example the response to question 1 

Bonjour ~ 5a va 
could be any of : 
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a) Bon jour 

b) Trfes bien merci 

c) vais trfes bien merci 

d) oe vais trfes bien merci, et vous 

All of the above responses would score a 2 on the first scale but on 
the second scale, answer a) would rate a one, b) would get 2, c) would get 
3 and d) would rate a 4. 

Questions 28, 29, 30 are scored as follows. On the first scale give 
one point for each "part" of the sentence the student attempted to repeat, 
for a maximum of 3. On the second scale give one point for each part of 
the sentence the student repeats absolutely correctly. 

As an example if a student said 

"La grand chien /mange /le petit poule" 
the student would score a 3 on the first scale, but only a 1 on the second 
scale "la grand" and "le petite" are incorrect- 

At the end of the interview rate the student on his Pronunciation, 
Fluency, Grammar, Vocabulary, and Comprehension as follows. 

Pronunciation 0 = often unintelligible 

1 = obviously foreign but rarely unintelligible 

2 = foreign but always intelligible 

3 = sometimes foreign, always intelligible 

4 = Native-like 

Fluency 0 = every utterance requires enormous obvious effort 

1 = very hesitant, often long pauses before answering 

2 = hesitant, must pause before answering 

3 = rarely hesitates 

4 = responds as well in English 

Grammar 0 = no control of syntax, often conveys wrong information 

1 = fair control of syntax, can convey meaning in simple 

phrases, although there are frequent errors 

2 = good control of syntax, conveys meaning weH, can 

formulate simple sentences, there are still errors 

3 = very good control, formulates more coftiplex sentences, 

relatively few errors 

4 = very good control, complex sentences, almost no errors 

Vocabulary 6 = almost no vocabulary at all 

1 = adequate for basic courtesy requirements 

2 = simple social and school needs . 

3 = adequate for simple general conversations 

4 = very good vocabulary, pan handle routine social and 

general conversations 
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Comprehension 0 = did not understuid most of questions asked, 
required frequent repetition, slow speech 

1 = understood most of what was said, required 

slow speech, some repetition 

2 = understood almost all of what was said, could 

follow slow speech with almost no repetition 

3 = understood most all of what was said at normal 

rate of speech. Very few repetitions 

4 = could follow all of what was said, no repetition 

required 

In the comments section note in particular any differences in the 
students willingness to respond as compared to his performance in English 



9 



-75- 



The Ontario Institute for Studies in Education 
Department of Measurement, Evaluatirn and 'Computer Applications 

French as a Second Language Monitor Study 



/ 



Interview Questions--English— 10 minutes 



1, 
2. 
3. 
4. 

5. 
6. 
7. 
8. 
9. 
10. 

■ 11. 

12. 

13. 
14. 

15. 

16. 
17. 
18. 
19. 

20. 
21. 
22. 
23 . 
24. 



Do you enjoy learning French at school? 

Can you tetl me one thing that you like about your French class? 

Can you tell me one thing you don't like about your French class? 

On the days you have French at school, is there one special French 
class that you like letter than the Others? A French class that 
you like more than the others? 

Why do you like this particular class more? 

Has your French class learned any French songs this year? 

How many French songs did your class learn? 

Can you name (up to) 3 of them for me? 

Can you name (up to 3) singers who sing songs in French? 

Do you speak to your French teacher in French when you are not in 

French class? 

At school do* you ever have a chance to speak to someone other than 
your French teacher in French? 

How often^? 0. never, 1. 1/i.ionth, 2. 2/month, 3. 3/month, 4. every week, 
5. more 

Do you have a French Club in your school? 

Did you learn anything about how French-speaking people celebrate 
Christmas and New Year in your French class this year? 
Did you learn anything about other special holidays or festivals that 
French-speaking people have? 

Can you name one? 

Do you play any special games in your French class? 
How often? 

Do yov ever get to see a movie in French or about French-speaking 
people at school? 

Do you listen to French iitories in your Frencn class? 
How often? 

Do you ever act out a Ut:le play in French at school? 
How often? 

Do you ever see a slide show in French or about French-speaking people 
at school? 




25. Do you ever have a chance to do something in French at school other 
than ^in French class (cooking, sports)? 

26 • How often? 

27. Is there someone at school other than your French teacher that you 
can ask for help in learning Fre^ich? 

.28. Do you ever have a chance to w^xk alone or in a small group with 
your French teacher? 

29. Do you ever get a chance to work alone or in a small group with 
a French-speaking person other than your French teacher? 

30- How often? 

31 • Do you ever listen to a French record in your free time? 

'M. Do you ever watch Freftch programs on T*V*? 

33* Do you think you would like to learn to speak French well? 

34. Do you think it i? important to learn French? 

35. bo you think you will study French in high school? 
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Interview Quest ions --French- -10 minutes 

1. Bon jour - 5a va? 

2. Comment t *appelleo-tu? 

3. Quel jour est-ce aujourd^hui? 

4. Dit moi (name), quel temps fait-il? 

5. Quelle est la date aujourd^hui? 

6. Quelle heure est-il? 

7. Qui est ton professeur de fran9ais? 

8. Ou est ton professeur de franQais maintenant? 

9. Combien de crayons y-a-t-il sur la table? (3) 

10. Ou est le livre? (sur) 

11. Ou est le stylo? (dans) 

12 Ou est la fille? (derriere) 

13. Ou sont les crayons? 

14. Combien de freres as-tu? 

15. As-tu des soeurs? ^ ^ 

16. Quel age as tu? \ 

17. Combien font 5 et 7? 

18. Lisez les numeros suivants 13, 15, 20, 21, 31, 50, 80, 81. 

19. Que fais-tu le samedl matin? 

20. Q.-elle est la date de Noel? 

21. De quelle coleur est la balie? (blanche) 

22. De quelle coaleur est le papier? (blanc) 

23. Quel temps fait-il pendant l^hiver? 

24. Quel temps fait-il pendant l^ete? 

25. Listen to the following situation and then answer in French. 

- You are in a McDonald ^s in Quebec City; the person behind the 
counter speaks only French. You want to order some milk. 
What would you say? 

26. You are visiting a school in Quebec where the kids speak only 
French. You want to find a washroom. What would you say? 

27. You are on a camping trip in Quebec. You stop in a small town 
to buy some groceries. The cl'^rk speaks only French, Ask him 
for eight apples. 
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It • 

You are going to hear a sentence read in French twice; after you have heard 
the sentence the second time I want you to repeat it. * . 

28. Le grand chien / mange / la petite poule. 

29. Les enfants / regardent / le cheval noir. 

30. Hier / j*ai / rencontre / mon ami Frangois. 
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CLASSROOM OBSERVATION 

The purpose of the classroom observation is to observe the behaviour 
of the selected classes in their normal classroom setting- The teacher 
should be ask^d not to do anything special for your visit but rather to 
carry on a normal class. 

The class is observed on the basis of teacher- student xnteractions. 
Each interaction is coded in one colunin on. the code sheet. 
Responses 

Class - Indicates the interaction was between the teacher 

and the class. A choral response. 

Correct - Indicates the student's response was judged correct 

or accepted as correct by the teacher* 

Incorrect - Indicates the student's response was judged 

incorrect by the teacher. 

No response - self-explanatcry. 

English . - Indicates the student's response was in English. 

Quality - is used to indicate the quality of the student's 

response. Use the same criteria as for the French 

interview. 

Prompts 

To Elicit - indicates the student was further prompted by the 

teacher in an attempt to get the student to respond. 
To Correct - the teacher prompted the student to correct a 

previously wrong answer. 
English - indicates the prompt was in English. 

Goes to other - indicates the teacher gave up on this particular 

student and went on to another, usually with the 

same or a similar question. 
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Teacher English - indicates the use of English by the teacher for 
explanation purposes. 

Under conmients and observations: Note the physical layout of the class 
rows, circle informal seating on floor etc. A general outline of the lesson, 
the French "ambiance" of the classroom, e.g., posters, charts, etc., for use 
in French class. 
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THE ONTARIO INSTITUTE FOR STUDIES IN EDUCATION 
Department of Measurement, Evaluation and Computer App3.ications 

trench as a Second Language Monitor Study 



STUDENT BACK.GKOUND INFORMATION QUESTIONNAIRE 



School Number 



1. 



3. 
4. 
5. 
6. 

7. 
8. 
9. 

10. 

11. 

11. 



What is your Student Number 
What is your date of birth 



(1 
(5 
(7 



year month day 
Please put a circle around the answer for the following questions: 
What grade are you in now? 4 5 6 7 8 9 

Are you a boy or a girl? 1. boy 2. girl 

Do you take French at school this year? 1. Yes 2, No 
In what grade did you start to study French at school? 

1 2 3 4 5 6 7 8 

Do you study French anywhere other than at school? 1. Yes 2. No 

If you answered YES to Question 7 wh^re do you study French? 

Does anyone at home speak a language other than English? 

i. Yes 2. No 

If yju answered YES to Question 9 what is the 

language they speak? . 

Do YOU speak any language other than English at home? 

1. Yes 2. No 

If .you answered YES to Question U what is the language 
you speak ar, home? , ^ 



■ 4) 

■ 6) 

■ U) 

(13) 

(14), 

(15) 

t 

(16)' 
(17) 
(18) 

(19) 

(20). 

(21) 

(227 
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APPENDIX B 



Reliability Estimates and Related Statistics for the Variables 
Derived 'from the French and English Interviews 
^ CN=384) 



Variables Pertaining to Competence in French 
26- Item Subtest of French Interview 
(includes situations) \ 

1. Number of failures ^o respond 

2. Number of correct responses 

3. Rated quality of response^ 

4. Number of prompts from interviewer 

4 -Item Subtest of |?rench Interview 

5. Number of units pronounced correctly 

Variables^derived^ from ^ the English Interview- 
ee Attitude toward the learning of French 
?• Knowledge oi- French culture 

8. Quality of experiences in French class 

9. Quantity of experiences in French 
class ' 



n 


is' 
1 


2 

.4 S 

X 


a 

a 


26 


5.52 


42.50 . 


0.90 


■ 26 


5.51 


43.71 


0.91 


26 


34.31 


312.94 
21.20/ 


n.93 


26 


4.60 


0.8' 


4 

\ 

\ 


5.52 


15.97 . 


O.b? 


7 


0.81 


1 . 29 


0.43 


3 


0.98 


1.21 


0.28 


17 


3l;24 


7.33 


0.59 


» 7 


i:»/6s 


. 25.11 


0.,57 



^Coefficient alpha (Cronbach, JL951) is defined as follows: 
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i 

Mea;ns and Startdard Deviations of Age Distributions,. 
Cross-Tabulations of Monitor and Control Groups, by 



ex 

Grade • • • j 

i 

Ability Rating • 

Grade in Which the Study of French Was Begun 

Whether the S »dent Does Not Speak English at Home 

Language the Student Speaks atN^ome . 7. 

Whether Anyone at Home Does Not opeak English 

Language Spoken by Someone at H(^e (Not English) 
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Means and Standard Deviations of Ag£ Distribution for Students 
in Monitor and Control Schools Separately by Province 

(Note: Age is Measured in Months) 



PROVINCE 



SCH TYPE 


SASK 


MAN 


P.E.I. 


ONT 


N.S. 


ROW 
TOTALS 


MONITOR 


48 
161.542 
7.973 


24 
131.625 
3.797 


0 

56 
138.288 
13 . 930 


12 
161.583 
8.339 


48 
143.813 
15.000 


198' 
145.869 
16.073 


CONTROL 


48 

161.792 
8.705 


12 . 
132.167 
5.750 


66 
137.152 
13.026 


12 
162.667 
10.899 


48 
144.708 
14.347 


146.785 
16.219 


TOTAL N 

MEAN 

S.D. 


96 
161.667 
8.304 


36 
131.806 
4.465 


132 
137.720 
13.446 


24 
162.125 
9.507 


96 
144.260 
14.607 


384 
146.313 
16.129 
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Cross -Tahulation-o£-S>tudfints-by-S.ex-aaOy- T>[pe. 

(Monicor vs. Control) Within Province 


ot Scnool 






<• 








SEX 










rKUV oL»n lire 


MALE 


FEMALE 


TOTALS 






SASK MONITOR 


25 


23 

4 


48 






COCTROL 


24 


24 


48 






MAN MONITOR 


12 


12 


24 






CONTROL 


6 


6 


12 






P.E.I. , MONITOR 


31 


35 


66 






CONTROL 


32 


34 


66 


• 




r\\vr MOM TTTi D 


4 


8 


12 






COJTROL 




' 12 








N.S. MONITOR 


24 


24 


48 






CONTROL 


20 


28 


48 






TOTAL N 


178 


206 


384 
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• 

• 






Cross-Tabulation of Students by Grade by Type of School 






TMonitor vs^ 


Contrail Within 


Province 








GRADE 








PROV 


SCH TYPE 


5 ' 6 


7 


8 


. ROW 
TOTALS 


SASK 


MONITOR 




24 


24 


48 




CONTROL 




• 24 


24 


48 


MAN 


MONITOR 
CONTROL 


24, 
12 






24 
12 


P.E.I. 


MONITOR 


45 9 


6 


6 


66 




CONTROL 


45 9 


6 


6 


66 


ONT , 


■ ^» ■ ■ ■ 

MONITOR 




6 


6 


• 12 




CONTROL 




6 


6 


■ . 12 


N.S. 


MONITOR 


24' 12 


6 


6 


48 




CONTROL 


24 12 


6'. 


6 


48 


TOTAL N ■ 




174 42 


84 


84 


384 
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Cross-Tabulation of Students by Ability Rdting by Type of School 
(Monitor vs. Contr ol) Within province 



ABIL. RATING 



ROW 



PROV 


SCH TYPE 


LOW 


AVERAGE 


HIGH 




TOTALS 


SASK 


MONITOR 


. ^ 15 


•17 


16 




48 




CONTROL 

c 


16 


16 


16 




HO 


MAN 


MONITOR 


8 


. - 8 


8 




24 




CONTROL 


4 


5 


3 






P.E.I. 


MONITOR 


- 22 


22 


22 




66 




CONTROL 


22 


22 


22 




66 


ONT 


MONITOR 


4 


4 


4 




12 




CONTROL 


3 


4 


5 




12 


N.S. 


MONITOR 


15 


17 


16 




48 




CONTROL 


15 


17 


16 




48 - ^■ 


TOTAL N 




124 


132 


128 




384 
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Cross-Tabulation of Students by Gr?ie in Whic.t the Study of French Was Begun 
by Type of School (Monitor vs. Control) Within Province 



STRT, GRD. FRNCH 



PROV. 


SCH TYPE 


GRADE 
FOUR 


GRADE 
FIVE 


GRADE 
SIX 

• 


GRADE 
SEVEN • 


ROW 
TOTALS 


SASK 


MONITOR 


• 






46 


48 




CONTROL 


1 • 






47 


48 


MAN 


MONITOR 


24 








■ 24 


^ 


CONTROL 


* -12' 






• 


12 


P.E.I. 


MONITOR 


40 


9 


6 


11 


66 




CONTROL 


38 


11 


5 


12 


>- 

66 


ONT 


MONITOR 
CONTROL 




12 
12 






12 
12 


N.S. 


MONITOR 


25 


12 


«» 


11 


48 




CONTROL 


■24 


12 




12 


48 


TOTAL N 




164' 


68 


13 


139 


• 384 



0 

t 

' 0 
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Cross-Tabulation of Students by Whether the Student Does Not Speak English 
at Home by Type of School (Monitor vs. Control) Within Province . 



PROV 



Is A Language Other Than English 
Spoken by Student at Home? 



SCH TYPE 



YES 



NO 



ROW 
TOTALS 



SASK 


MONITOR 
CONTROL . 


3 
4 


45 
44 


48 
48 


man' 


MONITOR 
CONTROL 


4 


20 
12 


24 
12 


P.E.I. 

•\ 


MONITOR 
CONTROL 


2 
3 


64 
63 


66 
66 


ONT 


MONITOR 
CONTROL 


5 
2 


7 

10 


12 
12 


N.S. 


MONITOR 
CONTROL 


5 
4 


• 43 
44 


48 
48 



• TOTAL N 



32 



352 



384 
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Cross-Tabulation of Stud^^nts by Language the Student Speaks at Home 
(If Not English) by Type of School (Monitor vs. Control) 
, Within Province 

f 

(Note: Three More Students Responded to This Question 
Than Said They Did Not Speak English at Home.) 

LANGUAGE STUDENTS SPEAK AT HCME 

ROW 



PROV. 


SCH TYPE 


FRENCH 


OTHER 


TOTALS 


SASK 


MONITOR 




4 


4 


• 


CONTROL 


- 


4 


4 . 


MAN 


MONITOR 


2 


2 


4 




Q 

CONTROL 




1 


1 


P-E.I. 


MONITOR 




3 


3. 




CONTROL 


3 




3 

t. 


om 


MONITOR 




5 


5 




CONTROL 




2 


2 


U.S. 


MONITOR 




5 . 


5 




CONTROL 


2 


2 


4 


TOTAL N 




7 


28 


35 
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Cross-Tabulation of Students by Whether Anyone at Home Does Not Speak 
English , by Type of School (Monitor vs. Control J withm Province 



DOES ANYONE AT HOME NOT SPEAK ENGLISH? 



ROW 



PROV 


cr*ij tVDC 
oLH loirt 


VPS 


'NO 


TOTALS 


SASK 


MONITOR 


23 


25 


48 




CONTROL 


26 


22 


48 


MAN 


MONITOR 


« 

11 


13 


24 




COOTROL 


2 


10 


JL4 


P.E.I. 


MONITOR 




57 


00 




COOTROL 


. 11 


55 


66 ^ 










^ 


ONT 


MONITOR 


7 


5 


1-2 ■ 




CONTROL 


3 


9 


12 


N.S. 


MONITOR 


14 


34 


48 




CONTROL 


12 


36 


48 



TOTAL N 



118 



266 



384 
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Cross-Tabulation of Students by The Language Spoken ^&y^"Someone at Home 
( Not English) '^ by Type of School (Monitor xs. Control) Within Province 

J (Note: Two More Students jResponded to This Question Than Reported 
/ That Someone at Home Speaks a Language Other Than English,) 





LANGUAGE SPOKEN BY SOMEONE AT HOME 




PROV 


SCH' TYPE 


FRENCH 


OTHER 


ROW 
TOTALS 


SASK 


MONITOR 


7 


16 • 


" - . 23 . 


J 


CONTROL 


3' 


23 


.26 


MAN 


MONITOR 


4 

• 


7- 


11 ' 




CONTROL 




2 


2 


P.E.I . 


MONITOR 


5 


6 


* 

1 I 
11 

* * 




CONTROL 


10 




11 


ONT 


MONITOR 




7 


7 




CONTROL 


\ 


3 


• ^ 3 ■ 


N.S. 


MONtTOR 


7 


7 


14 




CONTROL 


7 


5 


12 



TOTAL N 



43 



77 



120 
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Table 



Dl Pooled withinrcell Correlations (Class/School/Prov.) 

of Rating Variables and lEA Listening Comprehensidh. . 

Values of Univariate Mean Squares for Attitude ^ 
Variables;- Based on Data from Sask. , P.E.I., and- 
Nova Scotia 



D2 



D3 Varimax Rotated Factor Loadings for Significant «• 
Factors Extracted from the Correlation Matrices 
in Table 11 '-«\ 



D4 



Values of Univariate Mean Squares for Table 12, 
Ba?ed on Data from Sask., P.E.I. , and Nova Scotia. 
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t 

Talkie Dl 

Pooled withiii-cell Correlations CClass/School/Prov.) of Rating Variables 

and lEA Listening Comprehension 

(N=324, df=296, p < .01) 





'lEA 


Prpn, 


Fluency 


Grammar 


Vocab 




Pronunciation 


• 0.46 


* 






^ ^ t. 




Fluency 


.47 


.70 






•3 




Grammar 


.53 


.68 


.72 








Vocabulary 


.49 


.69 


.74 


.75 






Comprehension 


.54 


.72 


.74 . 


' .73 ' 


.76 
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APPENDIX D 
TAble D2 

Values of Univariate Mean Squares for Attitude Variables, Based on Data from Sask., 
P.E.I, and Nova Scotia. Arrows Indicate Error Term to be Used in F- ratios 





' 7^ 

Rrov. A 


1 S-P 


C:SP 


\ T 
_\ 


iXr 




1 Li . or « 


ni mm 


Attitude to French 


21.91 ^ 


3.75 


2.17 


\.78 


0.50 


1.08 


0.53 


1.15 


Knowledge of French Culture 


1.05 


5.87 


0. 86 


1.^8 


0.28 


3.28 


0.93 


• 79 


Quality of Experiences 


128.38 


46.97 


9. 35 


245.44 


19.99 


20.67 


"4.64 




Quantity of Experiences 


785.54 


149.69 


19.91 


699.31 


71.74 


73.31 
1 t 


5.39 

t 


9 .74 

1 


— — r "' 


■t 


1 t 


W 


+ 


t 

1 










Rating Variables: Univariate MS 


























Within 




• Prov. 


S:P 


'C:PS 


T 


TxP 


TS:P 


TC:SP 


Class 


Pronunciation . 


17.57 


2.36 


0.87 


7.72 


0.47 


2.11 


0.90 


.60 


Fluency 


25.86 


2.31 


0.68 


2.60 


2.05 


1.66 


1.18 


.66 


Grammar 


24.97 


1.90 


0.72 


4.00 


1.80 


1-756 


0.76 


.53 


Vocabulary - 


15.00 


3.20 


1.31 


7.72 


2.00 


1 .97 


0.71 

0 


.55 


Coinprehension . 


37.21 


"5.72 




4.00 


2.77 


■3.19 


0.84 


.65 

"T "". 


: - r ' 

> - * 


t 




1 + . 
W 


t i 




t 







I 

to 
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108 



103 



APPENDIX D 
Table D3 



Varimax Rotated Factor Loadings for Significant Factors Extracted from the 
Correlation Matrices iu Table IK Factor Loadings Less than 0,40 and 
Decimal Points Have Been Omitted.- Variables Are Listed in 
Order of Decreasing Loading on Factor 1 



Province 1 


Fa 


ctors 


Province 2 


Factors 


Province 3 

Variable Label 




V CIJL J. (XL/ JkC JJCilywJk 


1 


? 


5 




Variable Label 


1 


2 


1 


Grammar 


74 






1 


Fr. Cr. 23 Items 


92 




1 


Fr. Qual. 23 Items 


2 


Vocabulary 


69 






2 


Fr. Qual. 23 Items 


92 




2 


Fr. Cr. 23 Items 


3 


Pronunciation 


68 






3 


Fr. Pronun No. Cr. 


86 




3 


Fr. Pronun. No. Cr. 


4" 


Fr. Cr. 23 Items 


68 






4 


Fr. Qual. 3 Sits 


79 




4 


Fr..Qual. 3 Sits 


5 


Comprehension 


63 






5 


Fr. Cr. 3" Sits 


67 




5 


Fr. Cr. 3 Sits / 


6 


Fluency 








6 


Fr. Q18 Pronun. 


67 




6 


Fr. Q18 Pronun 


7 


lEA List. Comp 


53 






7 


Fr. Q18 No. Cr. 


65 




7 


Tt. Q18 No. Cr. 


8 


Fr. Qual. 23 Items 


53 


45 


50 


8 


Fr. Pron. No Rep. 


51 




8 


Fr. Pronun. No. Rep. 


9 


Fr. Pronun. No. Cr. 


51 




51- 


9 


Grammar 




91 


9 


Fluency 


10 


Fr. Cr. 3 Sits 


51 






10 


Comprehension 




' 90 


10 


Grammar 


11 


Fr. Q18 No. Cr. 




88 




11 


Vocabulary 




8d 


11 


Comprehension 


12 


Fr. Q18 Pronun. 




60 




12 


Pronunciation 




86 


12 


Vocabulary 


13 


Fr» Pronun. No. Rep 






80 


13 


Fluency ■ 




86 


13 


Pronunciation 


14 


Fr. Qual. 3 Sits 






40 


14 


lEA List. Con^. 




51 


14 


lEA List. Comp. 



Iterative factor analysis procedure in PSTAT: FACTOR, ROTATE, GRDUPCOR, BPRINT/0.40 (Buhier 
1979, pp. 248-252). • 
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APPENDDfD 
Table D4 

Values of Univariate Mean Squares for Table 12, Based on Data from Sask.> P.E.I. , 
and Nova Scotia. Arrows Indicate Error Term to be Used in F-ratios* 
Numbers in Parentheses are Degrees of Freedom 



















Within 




Prov. (2) 


S:PC11) 


C:SP(14) 


MCI) 


MxPC2> 


MS:P(11) 


MC:SP(14) 


Class (268) 


lEA Listening Comprehension 


663 . 86 


63.50 


50.85 


1.36 


8.97 


46.35 


21.06 


17.46 


RIGHTS 


472.50 


1175.27 


119.10 


1.00 


'^158.94 


123.75 


55.03* 


35.92 


COMPLETES 


821.44 


5752.90 


■ 649.21 


210.25 


6.48 


.430.51 


370.96* 


173.23 


Sum of Five Ratings 

r 


573.98 


63.51 


21.23 


124.69 


38.93 


46.35 


18.87 


11.14 


* 


t 


t 




t 




t 


t 










W 













I 

to 

f 



*Mean scores for classes in two schools in Province 2, The significant Monitor by 
Class interaction was traced to these schools. One Monitor class in School A had 
particularly, low scores and the other Monitor class had particularly high scores. 

COMPLETES 



RIGHl 


^S 


School A 
(Monitor) 


School B 
(Control) 


Class 1 


17.5 


22.7 


Class 2 


34.8 


21.5 





School A 


School B 




(Monitor)^ 


(Control) 


Class 1 


40.3 


58.3 


Class 2 


84.7 


51.7 



11- 



FRir 



113 



APPENDIX E 

FREQUENCY DISTRIBUTIONS OF DIFFERENCES BETWEEN PAIRED MONITOR 
AND CONTROL CLASSES ON THE OBSERVATION VARIABLES 



Table 

1 Total Number of Interactions 

2 Proportion of Teacher-Class Interaction. . . 
"3 Proportion of Correct Responses 

4 Proportion of Incorrect Responses 

5 Proportion of Times No Response Was Given. 

6 Proportion of Responses in English 



Page 

ia2 

102 
103 
103 
104 
104 



7 Proportion of Interactions during Which the Teacher 
Prompted the Student or Class in French in Order 
to Elicit a Response 



Proportion of Interactions during Which the Teacher 
Prompted the Student or Class in English in Order 
to Elicit a Response 

Proportion of Interactions during Which the Teacher 
Prompted the Student or Class in English 



lOS 



106 



10 Proportion of Interactions during Which the Teacher 

Moved to Another Student to Get a Response 



11 Proportion of Interactions during Which the Teacher 
Used English ' 



12 Average Quality Rating of Responses, 



107 
107 



-101- 



-102- 



APPENDIX E 



Frequency Distributions of Differences between Paired Monitor 
and Control Classes on the Observation Variables 



TABLE 1 

0 

_,^TOTAL NUMBER OF INTERACTIONS 



LOW 


HIGH 


N 


PCT 


CUM 


65.00 • 


65.00 


1 


5 


5 


43.00 


50.00 


3 


14 


19 


26.00 


37.00 


7 


33 


52 


21.50 


25.00 


3 


14 


67 


9.00 


10.00 


2 


10 


76 


-12.50 


-8.00 


3 


14 


90 


n on 










0.00 


0.00 








0.00 


0,00 








0.00 


0.00 








-75.00 


-75.00 


1 


5 


95 


-91.00 


■ -91.00 


1 


5 


100 


GOOD N 








21. 


MEAN 








14.8810 


i"S-.D. 








38.1454 


► * 


• 


TABLE 2 








PROPORTION OF 


TEACHER-CLASS 


INTERACTION 




LOW 


HIGH 


N 


PCT 


CUM 


0.65 


0.65 ^ 


1 


S 


5 


0.46 


0.46 


1 


5 


10 


0.40 


0.40 


1 


5 


14 


0.26 


0.26 


2 


10 


24 


0.16 


0.16 


1 


5 


' 29 


0.09 


0.10 


2 


10 


38 


-0.00 


0.04 


4 


19 


57 


-0.12 


-0.05 


4 


19 


7'6 


-0.17 


-0.16 


, 2 


10 


86 


-0.30 


-0.30 


1 


5 


90 


0.00 


0.00 








-0.52 


-0.50 


2 


10 


100 


GOOD N 








21. 


MEAN 


f 






0.0176 


S.D. 




lis 




0.2901 











-103--. 



TABLE 3 

PROPORTION OF CORRECT RESPONSES 



LOW ■ 


xiibn 




N 


0,25 






1 


Ann 


0 00 






0.14 






2 


U.uu 


0.00 






0.08 


0.08 




1 


0.01 


0.02 




3 


-0.03 


0.00 




7 


-0.06 


-0.04 




3 


-0.10 


-0.10 




2 


-0.15 


-0.15 




1 


0.00 


0.00 






-0.23 


-0.23 




1 



PCT 



CUM 



GOOD N 

MEAN 
S.D. 



10 

5 
14 
33 
14 
10 

5 



14 

19 
33 
67 
81 
90 
95 

100 

21. 

-0.0112 
0.1045 



TABLE 4 

PROPORTION OF INCORRECT RESPONSES 



LOW 



HIGH 



N 



PCT 



CUM 



1 


5 


5 


1 


5 


10 


2 


10 


19 


1 


5 


24 


6 


29 


52 


2 


10 


62 


3 


14 


76 


1 


5 


81 


2 


10 


90 


2 


10 


100 






21. 






0.0374 






0.1323 



0.38 

0.00 

0.00 

0.22 

0.16 

0.10 

0.06 

0.00 
-0.02 
-0.05 
-0.13 
-0.19 

GOOD N 

MEAN 
S.D. 



0.38 
0.00 
0.00 
0.22 
0.17 
0.10 
0.09 
0.01 
-0.01 
-0.05 
-0.10 
-0.18 



-104- 



TABLE 5 



PROPORTION OF TIMES NO RESPONSE WAS GIVEN 



LOW 


HIGH 




N 


PCT 


CUM 


U, XV 


A 11 




3 


14 


14 


U.UU 


A r> A 

0, 00 










A AA 

uu 


0.00 










0.00 


0.00 








• 


0*05 


0.06 




3 


14 


29 • 


0.04 


0.04 


0 


1 


s 


33 


0.00 


0.00 










0.01 


0.02 




2 


10 


43 


0.00 


0.01 




7 


33 


76 


-0.01 


-0.01 




1 


S 


81 


-0.02 


-0.01 




3 


14 


95 


A nA 


-0.04 




1 


5 


100 


GOOD N 










■ 21. 


MEAN 










0.0217* 


S.D. 










0.0428 


This means 


is significantly different from 


zero (p <.05) 








TABLE 6 










PROPORTION 


OF RESPONSES 


IN 


ENGLISH 


< 


I /\t>f 

LOW 


HIGH 




N 


PCT 


CUM 


0.21 


0.25 ■ 




3 


14 


14 - 


0.00 


0.00 










0.00 


0.00 










0. 10 


o.\o 




1 


5 


19 


0.06 


0.06 




1 


5 


24 


-0.01 


0.02 




10 


48 


71 


-0.03 


• ■ -0.02 




2 


10 


81 


-0.08 


-0.08 




1 


S 


86 


-0.14 


-0.10 




2 


10 


95 


0.00 


0.00 










0.00 


0.00 










-0.27 


-0.27 




1 


S 


100 



GOOD N 



21. 



MEAN 
S.D. 



0.0118 
0.1177 



117 



-105 



TABLE 7 



LQW 



PROPORTION OF INTERACTION DURING WHICH THE\ 
TEACHER PROMPTED THE STUDENT OR CLASS IN 
FRENCH IN ORDER TO ELICIT A RESPONSE 



HIGH 


M 


PPT 


0.21 


A 

*f 


19 


0.15 


i 


c 


0.13 


3 


14 


O.j09 


1 


5 


0.04 


3 


14 


0.00 


3 


14 


-0.03 




5 


-0.10 


2 


10 


0.00 






-d.l8 


1 


5 


-0.20 


1 


S 


-0.28 


1 


• 5 



CUM 



0.18 

0.15 

0.10 

O.09 

O.02 
-0.00 
-O.03 
-0.11 

COO 
-U.18 
-0.20 
-0.28 

GOOD N 

MEAN 
S.D. 



19 
24 
38 
43 
57 
71 
76 
86 

90 

95 
100 

.21. 

0.0250 
•0.1367 



LOW 



TABLE 8 

PROPORTION OF INTERACTIONS DURING WHICH THE 
TEACHER PROMPTED THE STUDENT OR CLASS IN 
ENGLISH IN ORDER TO CORRECT A RESPONSE 



HIGH 



u 


per 


CUM 


1 


5 


5 


1 


5 


■10 


1 


5 


14 


3 


14 


29 


5 


24 


52 


2 


10 


62 


2 


10 


71 


1 


5 


76 


3 


14 


90 


2 


lO 


100 




u 


21. 






0.0167 






0.1553 



0.40 

0.31 

0.00 

0.00 

0.14 

0.09 

0.03 
-0.01 
-0.06 
-0.10 
-0.16 
-0.23 

GOOD N 

MEAN 
S.D. 



0.40 
0.31 
0.00 
0.00 
0.14 
0.12 
0.06 
0.03 
-0.03 
-0.10 
-0.13 
-0.19 



118 



-106- 



TABLE 9 

PROPORTION OF INTERACTIONS DURING WHICH THE TEACHER 
PROMPTED THE STUDENT OR CLASS IN ENGLISH 

I 



LOW 


HIGH 


N 


PCT 


CUM 


0.06 


0.07 


2 ' 


10 


10 


0.00 


o.bo 










U • Ud 


1 

« X 


c 
D 


1 A 


0.00 


0.00 








n. nn 
U/. U.U 


n nn 








0.00 


0.00 








-0.01 


0.00 


12 


57 


71 


-0.02 


-0.01 


4 


19 


90 


0.00 


oso 








-o.os 


-0.05 


1 


5 


95 


0.00 


0.00 








-0.07 


-0.07 


1 


5 


100 


GOOD N 








21. 


MEAN 








0.0002 


S.D. 








• 0.0318 



TABLE 10 



PROPORTION OF INTERACTIONS DURING WHICH THE TEACHER 
MOVED TO ANOTHER STUDENT TO GET A RESPONSE 



LOW 


HIGH . 


N 


PCT 


CUM 


0.13 


0.13 , 


1 " 


5 


5 


0.00 


0.00 ■ 








0.08 


0.08 


1 


5 


10 


0.00 


0.00 








0.04 


0.04 


1 


5 


14 


0.02 


0.03 


3. 


14 


29 


-0.00 


0.01 


6 


29 


57 


-0.02 


-0.02 


3 


14 


71 


-0.03 


-0.02 


4 


19 


90 


-O.OS 


-O.OS 


1 


5 


95 


0.00 


0,00 








-0.10 


-0.10 


1 


S 


100 


GOOD N 








21. 


MEAN 








0.0017 


S.D. 








0.0459 



•107- 



. GOOD N 

MEAN 
S.D. 



TABLE 11 

PROPORTION OF INTERACTIONS DURING WHICH 
THE TEACHER USED ENGLISH 



LOW ^ 


nxbn 


N 


0.26 


n 9A 
u • 


1 


A A A 

0.00 






0. 14 




1 


0.10 


O.IO 


1 


0.00 


0.00 




^ 0.02 


o.os 


3 


-0.02 


0.00 


9 


-0.07 


-0.04 ' 


4 


-0.08 


-0.08 


1 


0.00 


0.00 




0.00 


0.00 




-0.24 


-0.24 


1 



PCT 



5 
5 

14 
43 
19 
5 



CUM 



14 

29 
^1 
90 
95 



100 

21. 

0.0024 
0.0954 



TABLE 12 

AVERAGE QUALITY RATING OF RESPONSES 



LOW 

1.11 

0.77 

0.61 

0.39 

0.16 
-0.10 
-0.25 
-0.39 

0.00 

0.00 
-0.96 
-1.31 

GOOD N 

MEAN 
S.D. 



HIGH 

l.'ll 
0.81 
0.68 
0.44 
0.29 
-0.03 
-0.22 
-0.39 
0.00 
0.00 
-0.96 
-1.31 



1 

2' 

3 

2 

S 

4 

2 

1 



PCT 
5 

10 
14 
10 
24 
14 
10 
5 



S 

s 



CUM 

s 

14 
29 
38 
62 
76 
86 
90 



95 
100 

21. 

0.1538 
0.5792 



ERIC 



120 



